Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PPO + JAX + EnvPool + Atari #227

Merged
merged 37 commits into from
Oct 6, 2022
Merged
Changes from 1 commit
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
52e62b4
PPO + jax + envpool + atari
vwxyzjn Jul 7, 2022
0e66dd4
fix bug: only report metric when lifes are used up
vwxyzjn Jul 11, 2022
2cf5c3a
pre-commit
vwxyzjn Jul 11, 2022
4c33285
quick fix
vwxyzjn Jul 11, 2022
9108810
Quick refactor
vwxyzjn Jul 11, 2022
cc1c7d9
Merge branch 'master' into jax-ppo-envpool-atari
vwxyzjn Aug 22, 2022
8449fe3
push changes
vwxyzjn Aug 22, 2022
73309a5
pre-commit and use EnvPool's new API
vwxyzjn Aug 22, 2022
2527d62
update envpool
vwxyzjn Aug 22, 2022
cc861e2
update docs
vwxyzjn Aug 24, 2022
1d57472
update ppo benchmark script
vwxyzjn Aug 24, 2022
beb82d2
update docs
vwxyzjn Aug 24, 2022
931593c
Merge branch 'master' into jax-ppo-envpool-atari
vwxyzjn Aug 25, 2022
3c5c499
Merge branch 'master' into jax-ppo-envpool-atari
vwxyzjn Aug 26, 2022
55c9a74
use the latest envpool interface
vwxyzjn Aug 26, 2022
5631fb5
update envpool to the latest version
vwxyzjn Aug 27, 2022
f1624cf
update pyproject.toml
vwxyzjn Aug 27, 2022
0fd6729
update lock files
vwxyzjn Aug 27, 2022
5c07c28
Quick clarification
vwxyzjn Aug 28, 2022
879965e
Merge branch 'jax-ppo-envpool-atari' of https://github.com/vwxyzjn/cl…
vwxyzjn Aug 28, 2022
ed1b15b
Update docs
vwxyzjn Sep 12, 2022
bc1b6d7
remove non benchmarked script
vwxyzjn Sep 12, 2022
0905b93
update docs
vwxyzjn Sep 12, 2022
217a108
revert poetry changes
vwxyzjn Oct 5, 2022
58318ec
Merge branch 'master' into jax-ppo-envpool-atari
vwxyzjn Oct 5, 2022
6a3c91a
docs fix
vwxyzjn Oct 5, 2022
5f2680f
remove uncessary code, add docs
vwxyzjn Oct 5, 2022
19cc1fe
add a note one envpool
vwxyzjn Oct 5, 2022
2b10f75
update test cases
vwxyzjn Oct 5, 2022
918ccdf
explain `get_action_and_value`
vwxyzjn Oct 5, 2022
ffde717
fix indent
vwxyzjn Oct 5, 2022
6b67283
Fix weird error with `np.mean`. See below:
vwxyzjn Oct 5, 2022
6aa73d0
update docs
vwxyzjn Oct 5, 2022
c61a521
pre-commit
vwxyzjn Oct 5, 2022
0f72ce0
add note on `charts/avg_episodic_return`
vwxyzjn Oct 5, 2022
8cbb5b1
update reproducibility script
vwxyzjn Oct 5, 2022
ed877ad
add note on value function clipping
vwxyzjn Oct 6, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
PPO + jax + envpool + atari
  • Loading branch information
vwxyzjn committed Jul 7, 2022

Verified

This commit was signed with the committer’s verified signature.
Eeems Nathaniel van Diepen
commit 52e62b4326d311262ff0d5305fe0b453e731741c
Loading