Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Versioning] Bump v0.8.0 #2845

Open
wants to merge 1 commit into
base: gh/vmoens/112/base
Choose a base branch
from
Open

[Versioning] Bump v0.8.0 #2845

wants to merge 1 commit into from

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Mar 10, 2025 •
edited
Loading

@vmoens
Update
39c7ef4 
[ghstack-poisoned]
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Mar 10, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2845

Note: Links to docs will display an error until the docs builds have been completed.

❌ 30 New Failures

As of commit 39c7ef4 with merge base 6e40548 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

This was referenced Mar 10, 2025
Open
Open
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 10, 2025
@vmoens vmoens mentioned this pull request Mar 10, 2025
Open
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}14$. Worsened: $\large\color{#d91a1a}14$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.9492s 0.8624s 1.1596 Ops/s 1.1752 Ops/s $\color{#d91a1a}-1.33\%$
test_transformed 1.6096s 1.5211s 0.6574 Ops/s 0.6540 Ops/s $\color{#35bf28}+0.53\%$
test_serial 2.5367s 2.4469s 0.4087 Ops/s 0.4095 Ops/s $\color{#d91a1a}-0.19\%$
test_parallel 1.8936s 1.8795s 0.5321 Ops/s 0.5218 Ops/s $\color{#35bf28}+1.97\%$
test_step_mdp_speed[True-True-True-True-True] 0.2131ms 40.8341μs 24.4893 KOps/s 24.8439 KOps/s $\color{#d91a1a}-1.43\%$
test_step_mdp_speed[True-True-True-True-False] 48.9020μs 23.8542μs 41.9213 KOps/s 43.3601 KOps/s $\color{#d91a1a}-3.32\%$
test_step_mdp_speed[True-True-True-False-True] 54.9720μs 22.7312μs 43.9925 KOps/s 45.0409 KOps/s $\color{#d91a1a}-2.33\%$
test_step_mdp_speed[True-True-True-False-False] 40.6220μs 13.3627μs 74.8352 KOps/s 77.8959 KOps/s $\color{#d91a1a}-3.93\%$
test_step_mdp_speed[True-True-False-True-True] 84.4440μs 43.8510μs 22.8045 KOps/s 23.7091 KOps/s $\color{#d91a1a}-3.82\%$
test_step_mdp_speed[True-True-False-True-False] 58.2830μs 26.5616μs 37.6483 KOps/s 39.8143 KOps/s $\textbf{\color{#d91a1a}-5.44\%}$
test_step_mdp_speed[True-True-False-False-True] 63.0130μs 25.1058μs 39.8315 KOps/s 40.6973 KOps/s $\color{#d91a1a}-2.13\%$
test_step_mdp_speed[True-True-False-False-False] 40.2120μs 15.5761μs 64.2007 KOps/s 66.1567 KOps/s $\color{#d91a1a}-2.96\%$
test_step_mdp_speed[True-False-True-True-True] 86.1340μs 45.9932μs 21.7423 KOps/s 22.3307 KOps/s $\color{#d91a1a}-2.63\%$
test_step_mdp_speed[True-False-True-True-False] 55.0420μs 28.9197μs 34.5785 KOps/s 36.5042 KOps/s $\textbf{\color{#d91a1a}-5.28\%}$
test_step_mdp_speed[True-False-True-False-True] 61.4520μs 25.1119μs 39.8217 KOps/s 41.1305 KOps/s $\color{#d91a1a}-3.18\%$
test_step_mdp_speed[True-False-True-False-False] 39.7720μs 15.7594μs 63.4542 KOps/s 65.4067 KOps/s $\color{#d91a1a}-2.99\%$
test_step_mdp_speed[True-False-False-True-True] 77.4330μs 47.5509μs 21.0301 KOps/s 21.8917 KOps/s $\color{#d91a1a}-3.94\%$
test_step_mdp_speed[True-False-False-True-False] 75.1330μs 30.8750μs 32.3887 KOps/s 33.2681 KOps/s $\color{#d91a1a}-2.64\%$
test_step_mdp_speed[True-False-False-False-True] 57.2020μs 27.4685μs 36.4054 KOps/s 37.4830 KOps/s $\color{#d91a1a}-2.87\%$
test_step_mdp_speed[True-False-False-False-False] 40.2320μs 17.8999μs 55.8661 KOps/s 56.4405 KOps/s $\color{#d91a1a}-1.02\%$
test_step_mdp_speed[False-True-True-True-True] 75.4940μs 45.7894μs 21.8391 KOps/s 22.1616 KOps/s $\color{#d91a1a}-1.46\%$
test_step_mdp_speed[False-True-True-True-False] 56.1620μs 28.8097μs 34.7105 KOps/s 35.2388 KOps/s $\color{#d91a1a}-1.50\%$
test_step_mdp_speed[False-True-True-False-True] 2.5478ms 29.7548μs 33.6080 KOps/s 35.0553 KOps/s $\color{#d91a1a}-4.13\%$
test_step_mdp_speed[False-True-True-False-False] 52.8320μs 17.6953μs 56.5122 KOps/s 58.0182 KOps/s $\color{#d91a1a}-2.60\%$
test_step_mdp_speed[False-True-False-True-True] 82.0830μs 48.2691μs 20.7172 KOps/s 21.2066 KOps/s $\color{#d91a1a}-2.31\%$
test_step_mdp_speed[False-True-False-True-False] 71.3930μs 31.3830μs 31.8644 KOps/s 32.4128 KOps/s $\color{#d91a1a}-1.69\%$
test_step_mdp_speed[False-True-False-False-True] 59.3720μs 31.8917μs 31.3561 KOps/s 32.9883 KOps/s $\color{#d91a1a}-4.95\%$
test_step_mdp_speed[False-True-False-False-False] 46.1820μs 20.0808μs 49.7989 KOps/s 51.3280 KOps/s $\color{#d91a1a}-2.98\%$
test_step_mdp_speed[False-False-True-True-True] 97.6140μs 51.3639μs 19.4689 KOps/s 20.0504 KOps/s $\color{#d91a1a}-2.90\%$
test_step_mdp_speed[False-False-True-True-False] 55.8020μs 33.8889μs 29.5082 KOps/s 30.1346 KOps/s $\color{#d91a1a}-2.08\%$
test_step_mdp_speed[False-False-True-False-True] 82.8930μs 31.9818μs 31.2678 KOps/s 32.7111 KOps/s $\color{#d91a1a}-4.41\%$
test_step_mdp_speed[False-False-True-False-False] 49.3830μs 20.1791μs 49.5562 KOps/s 51.1987 KOps/s $\color{#d91a1a}-3.21\%$
test_step_mdp_speed[False-False-False-True-True] 82.7040μs 52.5019μs 19.0469 KOps/s 19.4697 KOps/s $\color{#d91a1a}-2.17\%$
test_step_mdp_speed[False-False-False-True-False] 90.6540μs 35.9439μs 27.8212 KOps/s 28.9379 KOps/s $\color{#d91a1a}-3.86\%$
test_step_mdp_speed[False-False-False-False-True] 68.5930μs 33.4173μs 29.9246 KOps/s 30.7601 KOps/s $\color{#d91a1a}-2.72\%$
test_step_mdp_speed[False-False-False-False-False] 59.8530μs 22.2650μs 44.9135 KOps/s 45.6330 KOps/s $\color{#d91a1a}-1.58\%$
test_values[generalized_advantage_estimate-True-True] 26.9277ms 26.5188ms 37.7091 Ops/s 38.5571 Ops/s $\color{#d91a1a}-2.20\%$
test_values[vec_generalized_advantage_estimate-True-True] 96.9791ms 2.8569ms 350.0349 Ops/s 347.8773 Ops/s $\color{#35bf28}+0.62\%$
test_values[td0_return_estimate-False-False] 0.1071ms 81.8578μs 12.2163 KOps/s 12.2962 KOps/s $\color{#d91a1a}-0.65\%$
test_values[td1_return_estimate-False-False] 59.5619ms 57.9002ms 17.2711 Ops/s 17.5550 Ops/s $\color{#d91a1a}-1.62\%$
test_values[vec_td1_return_estimate-False-False] 1.4346ms 1.1146ms 897.1686 Ops/s 911.8780 Ops/s $\color{#d91a1a}-1.61\%$
test_values[td_lambda_return_estimate-True-False] 94.6629ms 92.5787ms 10.8016 Ops/s 11.0895 Ops/s $\color{#d91a1a}-2.60\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.3934ms 1.1120ms 899.2828 Ops/s 912.6723 Ops/s $\color{#d91a1a}-1.47\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 26.7173ms 26.0418ms 38.3998 Ops/s 39.0147 Ops/s $\color{#d91a1a}-1.58\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.0549ms 0.7826ms 1.2778 KOps/s 1.3049 KOps/s $\color{#d91a1a}-2.08\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7361ms 0.6877ms 1.4542 KOps/s 1.4748 KOps/s $\color{#d91a1a}-1.40\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5526ms 1.5084ms 662.9365 Ops/s 667.6441 Ops/s $\color{#d91a1a}-0.71\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7712ms 0.7016ms 1.4253 KOps/s 1.3859 KOps/s $\color{#35bf28}+2.84\%$
test_dqn_speed[False-None] 1.6671ms 1.5614ms 640.4311 Ops/s 641.2518 Ops/s $\color{#d91a1a}-0.13\%$
test_dqn_speed[False-backward] 2.3530ms 2.2044ms 453.6294 Ops/s 457.9898 Ops/s $\color{#d91a1a}-0.95\%$
test_dqn_speed[True-None] 0.7356ms 0.5615ms 1.7810 KOps/s 1.7783 KOps/s $\color{#35bf28}+0.15\%$
test_dqn_speed[True-backward] 1.2037ms 1.1514ms 868.5185 Ops/s 875.5051 Ops/s $\color{#d91a1a}-0.80\%$
test_dqn_speed[reduce-overhead-None] 0.8028ms 0.5786ms 1.7282 KOps/s 1.7294 KOps/s $\color{#d91a1a}-0.07\%$
test_dqn_speed[reduce-overhead-backward] 1.0427ms 0.9828ms 1.0176 KOps/s 1.0142 KOps/s $\color{#35bf28}+0.33\%$
test_ddpg_speed[False-None] 3.2590ms 2.9411ms 340.0134 Ops/s 343.3349 Ops/s $\color{#d91a1a}-0.97\%$
test_ddpg_speed[False-backward] 4.7123ms 4.2640ms 234.5239 Ops/s 236.8173 Ops/s $\color{#d91a1a}-0.97\%$
test_ddpg_speed[True-None] 1.5289ms 1.3745ms 727.5629 Ops/s 743.0967 Ops/s $\color{#d91a1a}-2.09\%$
test_ddpg_speed[True-backward] 2.6785ms 2.6195ms 381.7520 Ops/s 400.7779 Ops/s $\color{#d91a1a}-4.75\%$
test_ddpg_speed[reduce-overhead-None] 1.4681ms 1.3737ms 727.9620 Ops/s 733.8981 Ops/s $\color{#d91a1a}-0.81\%$
test_ddpg_speed[reduce-overhead-backward] 2.0346ms 1.9370ms 516.2644 Ops/s 482.4056 Ops/s $\textbf{\color{#35bf28}+7.02\%}$
test_sac_speed[False-None] 8.7386ms 8.3277ms 120.0807 Ops/s 120.9169 Ops/s $\color{#d91a1a}-0.69\%$
test_sac_speed[False-backward] 11.7639ms 11.2961ms 88.5262 Ops/s 86.1261 Ops/s $\color{#35bf28}+2.79\%$
test_sac_speed[True-None] 2.0375ms 1.8789ms 532.2358 Ops/s 538.6260 Ops/s $\color{#d91a1a}-1.19\%$
test_sac_speed[True-backward] 3.9377ms 3.8664ms 258.6379 Ops/s 261.4204 Ops/s $\color{#d91a1a}-1.06\%$
test_sac_speed[reduce-overhead-None] 21.0608ms 11.9996ms 83.3364 Ops/s 82.8318 Ops/s $\color{#35bf28}+0.61\%$
test_sac_speed[reduce-overhead-backward] 1.6524ms 1.6128ms 620.0549 Ops/s 553.0499 Ops/s $\textbf{\color{#35bf28}+12.12\%}$
test_redq_speed[False-None] 8.4658ms 7.9536ms 125.7294 Ops/s 127.3224 Ops/s $\color{#d91a1a}-1.25\%$
test_redq_speed[False-backward] 12.2505ms 11.8150ms 84.6382 Ops/s 82.0665 Ops/s $\color{#35bf28}+3.13\%$
test_redq_speed[True-None] 2.5324ms 2.3799ms 420.1944 Ops/s 410.9619 Ops/s $\color{#35bf28}+2.25\%$
test_redq_speed[True-backward] 4.5701ms 4.3352ms 230.6710 Ops/s 242.8361 Ops/s $\textbf{\color{#d91a1a}-5.01\%}$
test_redq_speed[reduce-overhead-None] 2.7118ms 2.3958ms 417.3927 Ops/s 420.5683 Ops/s $\color{#d91a1a}-0.76\%$
test_redq_speed[reduce-overhead-backward] 4.7641ms 4.3646ms 229.1158 Ops/s 239.4646 Ops/s $\color{#d91a1a}-4.32\%$
test_redq_deprec_speed[False-None] 10.1505ms 9.8014ms 102.0260 Ops/s 106.7115 Ops/s $\color{#d91a1a}-4.39\%$
test_redq_deprec_speed[False-backward] 13.2073ms 12.7657ms 78.3348 Ops/s 80.5690 Ops/s $\color{#d91a1a}-2.77\%$
test_redq_deprec_speed[True-None] 3.0946ms 2.6924ms 371.4094 Ops/s 373.0195 Ops/s $\color{#d91a1a}-0.43\%$
test_redq_deprec_speed[True-backward] 5.1331ms 4.6507ms 215.0208 Ops/s 221.3278 Ops/s $\color{#d91a1a}-2.85\%$
test_redq_deprec_speed[reduce-overhead-None] 3.7037ms 2.7537ms 363.1450 Ops/s 373.6156 Ops/s $\color{#d91a1a}-2.80\%$
test_redq_deprec_speed[reduce-overhead-backward] 5.1057ms 4.6294ms 216.0087 Ops/s 225.8372 Ops/s $\color{#d91a1a}-4.35\%$
test_td3_speed[False-None] 8.5112ms 8.2767ms 120.8216 Ops/s 122.6680 Ops/s $\color{#d91a1a}-1.51\%$
test_td3_speed[False-backward] 11.6733ms 10.9269ms 91.5174 Ops/s 94.9549 Ops/s $\color{#d91a1a}-3.62\%$
test_td3_speed[True-None] 1.7747ms 1.7367ms 575.7940 Ops/s 600.1312 Ops/s $\color{#d91a1a}-4.06\%$
test_td3_speed[True-backward] 3.4362ms 3.2952ms 303.4729 Ops/s 305.0580 Ops/s $\color{#d91a1a}-0.52\%$
test_td3_speed[reduce-overhead-None] 77.3002ms 26.5549ms 37.6578 Ops/s 37.9379 Ops/s $\color{#d91a1a}-0.74\%$
test_td3_speed[reduce-overhead-backward] 1.4076ms 1.3479ms 741.8996 Ops/s 741.6218 Ops/s $\color{#35bf28}+0.04\%$
test_cql_speed[False-None] 18.5313ms 17.3624ms 57.5958 Ops/s 58.1225 Ops/s $\color{#d91a1a}-0.91\%$
test_cql_speed[False-backward] 22.9615ms 22.5551ms 44.3358 Ops/s 44.3183 Ops/s $\color{#35bf28}+0.04\%$
test_cql_speed[True-None] 3.4469ms 3.3373ms 299.6402 Ops/s 299.5215 Ops/s $\color{#35bf28}+0.04\%$
test_cql_speed[True-backward] 6.2449ms 5.7265ms 174.6282 Ops/s 175.1774 Ops/s $\color{#d91a1a}-0.31\%$
test_cql_speed[reduce-overhead-None] 0.5894s 16.3129ms 61.3011 Ops/s 76.0607 Ops/s $\textbf{\color{#d91a1a}-19.41\%}$
test_cql_speed[reduce-overhead-backward] 1.8788ms 1.8245ms 548.1056 Ops/s 504.8698 Ops/s $\textbf{\color{#35bf28}+8.56\%}$
test_a2c_speed[False-None] 3.4179ms 3.2890ms 304.0402 Ops/s 303.4712 Ops/s $\color{#35bf28}+0.19\%$
test_a2c_speed[False-backward] 6.9372ms 6.3180ms 158.2778 Ops/s 150.3834 Ops/s $\textbf{\color{#35bf28}+5.25\%}$
test_a2c_speed[True-None] 1.4872ms 1.3622ms 734.1186 Ops/s 723.3999 Ops/s $\color{#35bf28}+1.48\%$
test_a2c_speed[True-backward] 3.0267ms 2.9758ms 336.0435 Ops/s 319.3979 Ops/s $\textbf{\color{#35bf28}+5.21\%}$
test_a2c_speed[reduce-overhead-None] 15.8364ms 9.0442ms 110.5687 Ops/s 108.3621 Ops/s $\color{#35bf28}+2.04\%$
test_a2c_speed[reduce-overhead-backward] 1.5278ms 1.4866ms 672.6812 Ops/s 655.2515 Ops/s $\color{#35bf28}+2.66\%$
test_ppo_speed[False-None] 4.1877ms 3.8237ms 261.5269 Ops/s 250.0693 Ops/s $\color{#35bf28}+4.58\%$
test_ppo_speed[False-backward] 7.4173ms 6.9968ms 142.9224 Ops/s 138.8465 Ops/s $\color{#35bf28}+2.94\%$
test_ppo_speed[True-None] 1.4854ms 1.4432ms 692.9009 Ops/s 688.1033 Ops/s $\color{#35bf28}+0.70\%$
test_ppo_speed[True-backward] 3.1798ms 3.1330ms 319.1838 Ops/s 300.3146 Ops/s $\textbf{\color{#35bf28}+6.28\%}$
test_ppo_speed[reduce-overhead-None] 1.0659ms 0.9794ms 1.0210 KOps/s 1.0313 KOps/s $\color{#d91a1a}-0.99\%$
test_ppo_speed[reduce-overhead-backward] 1.5706ms 1.4423ms 693.3267 Ops/s 619.1392 Ops/s $\textbf{\color{#35bf28}+11.98\%}$
test_reinforce_speed[False-None] 2.4771ms 2.3298ms 429.2219 Ops/s 425.8397 Ops/s $\color{#35bf28}+0.79\%$
test_reinforce_speed[False-backward] 3.4220ms 3.3657ms 297.1181 Ops/s 285.5183 Ops/s $\color{#35bf28}+4.06\%$
test_reinforce_speed[True-None] 1.4081ms 1.3127ms 761.7780 Ops/s 760.4569 Ops/s $\color{#35bf28}+0.17\%$
test_reinforce_speed[True-backward] 3.0704ms 3.0132ms 331.8715 Ops/s 319.0575 Ops/s $\color{#35bf28}+4.02\%$
test_reinforce_speed[reduce-overhead-None] 19.6502ms 10.3982ms 96.1706 Ops/s 94.0516 Ops/s $\color{#35bf28}+2.25\%$
test_reinforce_speed[reduce-overhead-backward] 1.5553ms 1.5086ms 662.8784 Ops/s 597.6531 Ops/s $\textbf{\color{#35bf28}+10.91\%}$
test_iql_speed[False-None] 9.9304ms 9.5019ms 105.2416 Ops/s 104.1164 Ops/s $\color{#35bf28}+1.08\%$
test_iql_speed[False-backward] 13.7175ms 13.2325ms 75.5717 Ops/s 72.6723 Ops/s $\color{#35bf28}+3.99\%$
test_iql_speed[True-None] 2.4465ms 2.3339ms 428.4692 Ops/s 436.9133 Ops/s $\color{#d91a1a}-1.93\%$
test_iql_speed[True-backward] 5.3791ms 4.9313ms 202.7882 Ops/s 195.7294 Ops/s $\color{#35bf28}+3.61\%$
test_iql_speed[reduce-overhead-None] 0.5239s 13.1297ms 76.1632 Ops/s 88.4290 Ops/s $\textbf{\color{#d91a1a}-13.87\%}$
test_iql_speed[reduce-overhead-backward] 1.9308ms 1.9014ms 525.9306 Ops/s 478.1119 Ops/s $\textbf{\color{#35bf28}+10.00\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.7227ms 6.2544ms 159.8862 Ops/s 157.9209 Ops/s $\color{#35bf28}+1.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6073ms 0.3491ms 2.8647 KOps/s 3.0577 KOps/s $\textbf{\color{#d91a1a}-6.31\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6708ms 0.3276ms 3.0525 KOps/s 3.2452 KOps/s $\textbf{\color{#d91a1a}-5.94\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.2373ms 6.0075ms 166.4578 Ops/s 165.0795 Ops/s $\color{#35bf28}+0.83\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.6129ms 0.2857ms 3.4999 KOps/s 3.4898 KOps/s $\color{#35bf28}+0.29\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6328ms 0.3049ms 3.2802 KOps/s 3.3142 KOps/s $\color{#d91a1a}-1.02\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7054ms 1.4280ms 700.2724 Ops/s 771.6493 Ops/s $\textbf{\color{#d91a1a}-9.25\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5681ms 1.3282ms 752.9207 Ops/s 834.1076 Ops/s $\textbf{\color{#d91a1a}-9.73\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.2784ms 6.1118ms 163.6168 Ops/s 161.0404 Ops/s $\color{#35bf28}+1.60\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.8038ms 0.4118ms 2.4284 KOps/s 2.4033 KOps/s $\color{#35bf28}+1.04\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7131ms 0.4808ms 2.0800 KOps/s 2.5086 KOps/s $\textbf{\color{#d91a1a}-17.09\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.1124ms 6.0128ms 166.3108 Ops/s 164.5170 Ops/s $\color{#35bf28}+1.09\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7613ms 0.3758ms 2.6611 KOps/s 3.0819 KOps/s $\textbf{\color{#d91a1a}-13.66\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5714ms 0.3380ms 2.9583 KOps/s 3.3588 KOps/s $\textbf{\color{#d91a1a}-11.92\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.3310ms 5.9639ms 167.6746 Ops/s 166.1588 Ops/s $\color{#35bf28}+0.91\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.9008ms 0.3121ms 3.2042 KOps/s 3.2930 KOps/s $\color{#d91a1a}-2.70\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5336ms 0.2864ms 3.4911 KOps/s 4.0909 KOps/s $\textbf{\color{#d91a1a}-14.66\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.2789ms 6.1414ms 162.8296 Ops/s 160.0177 Ops/s $\color{#35bf28}+1.76\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0986ms 0.4233ms 2.3622 KOps/s 2.3778 KOps/s $\color{#d91a1a}-0.66\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6557ms 0.4259ms 2.3481 KOps/s 2.4665 KOps/s $\color{#d91a1a}-4.80\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 7.0144ms 5.4669ms 182.9176 Ops/s 177.7270 Ops/s $\color{#35bf28}+2.92\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 10.2057ms 2.1060ms 474.8450 Ops/s 430.7866 Ops/s $\textbf{\color{#35bf28}+10.23\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.7563ms 1.2122ms 824.9637 Ops/s 903.4793 Ops/s $\textbf{\color{#d91a1a}-8.69\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 7.2113ms 5.6076ms 178.3286 Ops/s 174.5603 Ops/s $\color{#35bf28}+2.16\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 10.8038ms 2.1167ms 472.4384 Ops/s 439.8217 Ops/s $\textbf{\color{#35bf28}+7.42\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 3.5199ms 1.1651ms 858.3013 Ops/s 813.0128 Ops/s $\textbf{\color{#35bf28}+5.57\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.5247s 16.2024ms 61.7192 Ops/s 30.4416 Ops/s $\textbf{\color{#35bf28}+102.75\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 8.2809ms 2.1883ms 456.9779 Ops/s 440.6078 Ops/s $\color{#35bf28}+3.72\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 8.7220ms 1.3807ms 724.2560 Ops/s 728.9407 Ops/s $\color{#d91a1a}-0.64\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 13.8493ms 13.5031ms 74.0572 Ops/s 72.4150 Ops/s $\color{#35bf28}+2.27\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.0943ms 17.1287ms 58.3814 Ops/s 57.1277 Ops/s $\color{#35bf28}+2.19\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 18.3081ms 17.9233ms 55.7932 Ops/s 52.9288 Ops/s $\textbf{\color{#35bf28}+5.41\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 18.9843ms 17.3910ms 57.5009 Ops/s 56.3285 Ops/s $\color{#35bf28}+2.08\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 18.2699ms 17.9645ms 55.6653 Ops/s 54.2047 Ops/s $\color{#35bf28}+2.69\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 19.9603ms 18.6817ms 53.5282 Ops/s 51.9841 Ops/s $\color{#35bf28}+2.97\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot