pushing model
Browse files- .gitattributes +4 -0
- README.md +1 -1
- events.out.tfevents.1702924587.4090-171.159914.0 β events.out.tfevents.1704452504.4090-171.104631.0 +1 -1
- ppo_fix_continuous_action.py +1 -1
- replay.mp4 +0 -0
- videos/Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval/rl-video-episode-8.mp4 +0 -0
- videos/{Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval β Hopper-v4__ppo_fix_continuous_action__5__1704452497-eval}/rl-video-episode-0.mp4 +2 -2
- videos/{Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval β Hopper-v4__ppo_fix_continuous_action__5__1704452497-eval}/rl-video-episode-1.mp4 +2 -2
- videos/Hopper-v4__ppo_fix_continuous_action__5__1704452497-eval/rl-video-episode-8.mp4 +3 -0
.gitattributes
CHANGED
@@ -35,3 +35,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
videos/Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval/rl-video-episode-1.mp4 filter=lfs diff=lfs merge=lfs -text
|
37 |
videos/Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval/rl-video-episode-0.mp4 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
videos/Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval/rl-video-episode-1.mp4 filter=lfs diff=lfs merge=lfs -text
|
37 |
videos/Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval/rl-video-episode-0.mp4 filter=lfs diff=lfs merge=lfs -text
|
38 |
+
videos/Hopper-v4__ppo_fix_continuous_action__5__1704452497-eval/rl-video-episode-8.mp4 filter=lfs diff=lfs merge=lfs -text
|
39 |
+
videos/Hopper-v4__ppo_fix_continuous_action__5__1704452497-eval/rl-video-episode-1.mp4 filter=lfs diff=lfs merge=lfs -text
|
40 |
+
videos/Hopper-v4__ppo_fix_continuous_action__5__1704452497-eval/rl-video-episode-0.mp4 filter=lfs diff=lfs merge=lfs -text
|
41 |
+
replay.mp4 filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
@@ -16,7 +16,7 @@ model-index:
|
|
16 |
type: Hopper-v4
|
17 |
metrics:
|
18 |
- type: mean_reward
|
19 |
-
value:
|
20 |
name: mean_reward
|
21 |
verified: false
|
22 |
---
|
|
|
16 |
type: Hopper-v4
|
17 |
metrics:
|
18 |
- type: mean_reward
|
19 |
+
value: 3278.01 +/- 586.81
|
20 |
name: mean_reward
|
21 |
verified: false
|
22 |
---
|
events.out.tfevents.1702924587.4090-171.159914.0 β events.out.tfevents.1704452504.4090-171.104631.0
RENAMED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 561797
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0195bb6fbefca6363d0471d31dc3607ddeca550eb08dbc5cbc91dc0ec1476ccc
|
3 |
size 561797
|
ppo_fix_continuous_action.py
CHANGED
@@ -430,7 +430,7 @@ if __name__ == "__main__":
|
|
430 |
|
431 |
# https://github.com/DLR-RM/stable-baselines3/pull/658
|
432 |
for idx, trunc in enumerate(truncations):
|
433 |
-
if trunc:
|
434 |
real_next_obs = infos["final_observation"][idx]
|
435 |
with torch.no_grad():
|
436 |
terminal_value = agent.get_value(torch.Tensor(real_next_obs).to(device)).reshape(1, -1)[0][0]
|
|
|
430 |
|
431 |
# https://github.com/DLR-RM/stable-baselines3/pull/658
|
432 |
for idx, trunc in enumerate(truncations):
|
433 |
+
if trunc and not terminations[idx]:
|
434 |
real_next_obs = infos["final_observation"][idx]
|
435 |
with torch.no_grad():
|
436 |
terminal_value = agent.get_value(torch.Tensor(real_next_obs).to(device)).reshape(1, -1)[0][0]
|
replay.mp4
CHANGED
Binary files a/replay.mp4 and b/replay.mp4 differ
|
|
videos/Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval/rl-video-episode-8.mp4
DELETED
Binary file (929 kB)
|
|
videos/{Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval β Hopper-v4__ppo_fix_continuous_action__5__1704452497-eval}/rl-video-episode-0.mp4
RENAMED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1eabca4603f0819dbcf411ae43cc371ea804d13960f3cdf6781c6deac8ceca43
|
3 |
+
size 1561721
|
videos/{Hopper-v4__ppo_fix_continuous_action__5__1702924580-eval β Hopper-v4__ppo_fix_continuous_action__5__1704452497-eval}/rl-video-episode-1.mp4
RENAMED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8ae1e5b712e203d5348a5c789fc45aec338e27ab2af2ae4c2dd53e2ecff9a455
|
3 |
+
size 1560520
|
videos/Hopper-v4__ppo_fix_continuous_action__5__1704452497-eval/rl-video-episode-8.mp4
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8497194df11fce0978beb1362db07d440fcccb833a89e4c9b1e2ec48f7ff9c0b
|
3 |
+
size 1555214
|