Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Add pybind11 to list of deps #2846

Open
wants to merge 1 commit into
base: gh/vmoens/113/base
Choose a base branch
from
Open

[CI] Add pybind11 to list of deps #2846

wants to merge 1 commit into from

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Mar 10, 2025 •
edited
Loading

@vmoens
Update
41b2270 
[ghstack-poisoned]
This was referenced Mar 10, 2025
Open
Open
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Mar 10, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2846

Note: Links to docs will display an error until the docs builds have been completed.

❌ 30 New Failures

As of commit 41b2270 with merge base 6e40548 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

vmoens added a commit that referenced this pull request Mar 10, 2025
@vmoens
[CI] Add pybind11 to list of deps
6f2e194 
ghstack-source-id: f32dfa9443eac8c1a2586763fe1be0b10be7496e
Pull Request resolved: #2846
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 10, 2025
@vmoens vmoens mentioned this pull request Mar 10, 2025
Open
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}18$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.9518s 0.8676s 1.1526 Ops/s 1.2147 Ops/s $\textbf{\color{#d91a1a}-5.11\%}$
test_transformed 1.6273s 1.5396s 0.6495 Ops/s 0.6783 Ops/s $\color{#d91a1a}-4.24\%$
test_serial 2.5725s 2.4856s 0.4023 Ops/s 0.4210 Ops/s $\color{#d91a1a}-4.44\%$
test_parallel 2.0668s 1.9132s 0.5227 Ops/s 0.5241 Ops/s $\color{#d91a1a}-0.27\%$
test_step_mdp_speed[True-True-True-True-True] 0.1803ms 42.0553μs 23.7782 KOps/s 23.7886 KOps/s $\color{#d91a1a}-0.04\%$
test_step_mdp_speed[True-True-True-True-False] 51.9910μs 24.3076μs 41.1394 KOps/s 40.8614 KOps/s $\color{#35bf28}+0.68\%$
test_step_mdp_speed[True-True-True-False-True] 53.6720μs 23.1905μs 43.1210 KOps/s 44.1202 KOps/s $\color{#d91a1a}-2.26\%$
test_step_mdp_speed[True-True-True-False-False] 44.2610μs 13.4453μs 74.3756 KOps/s 76.0980 KOps/s $\color{#d91a1a}-2.26\%$
test_step_mdp_speed[True-True-False-True-True] 0.1099ms 43.1387μs 23.1810 KOps/s 22.9225 KOps/s $\color{#35bf28}+1.13\%$
test_step_mdp_speed[True-True-False-True-False] 53.8210μs 26.2072μs 38.1575 KOps/s 38.0106 KOps/s $\color{#35bf28}+0.39\%$
test_step_mdp_speed[True-True-False-False-True] 50.6010μs 25.3982μs 39.3729 KOps/s 39.2313 KOps/s $\color{#35bf28}+0.36\%$
test_step_mdp_speed[True-True-False-False-False] 51.9910μs 15.9178μs 62.8227 KOps/s 63.6846 KOps/s $\color{#d91a1a}-1.35\%$
test_step_mdp_speed[True-False-True-True-True] 73.5920μs 47.1308μs 21.2176 KOps/s 21.6491 KOps/s $\color{#d91a1a}-1.99\%$
test_step_mdp_speed[True-False-True-True-False] 77.5620μs 29.2030μs 34.2431 KOps/s 34.7604 KOps/s $\color{#d91a1a}-1.49\%$
test_step_mdp_speed[True-False-True-False-True] 63.0910μs 25.9492μs 38.5368 KOps/s 39.5427 KOps/s $\color{#d91a1a}-2.54\%$
test_step_mdp_speed[True-False-True-False-False] 39.1910μs 15.8530μs 63.0796 KOps/s 63.8379 KOps/s $\color{#d91a1a}-1.19\%$
test_step_mdp_speed[True-False-False-True-True] 77.6010μs 49.3234μs 20.2743 KOps/s 20.5539 KOps/s $\color{#d91a1a}-1.36\%$
test_step_mdp_speed[True-False-False-True-False] 66.3910μs 31.2374μs 32.0129 KOps/s 32.4490 KOps/s $\color{#d91a1a}-1.34\%$
test_step_mdp_speed[True-False-False-False-True] 54.4310μs 28.3798μs 35.2364 KOps/s 35.9164 KOps/s $\color{#d91a1a}-1.89\%$
test_step_mdp_speed[True-False-False-False-False] 60.1110μs 18.5717μs 53.8454 KOps/s 55.2225 KOps/s $\color{#d91a1a}-2.49\%$
test_step_mdp_speed[False-True-True-True-True] 80.1620μs 46.8760μs 21.3329 KOps/s 21.5366 KOps/s $\color{#d91a1a}-0.95\%$
test_step_mdp_speed[False-True-True-True-False] 59.4010μs 29.3992μs 34.0145 KOps/s 34.1553 KOps/s $\color{#d91a1a}-0.41\%$
test_step_mdp_speed[False-True-True-False-True] 2.4848ms 30.5412μs 32.7426 KOps/s 33.4018 KOps/s $\color{#d91a1a}-1.97\%$
test_step_mdp_speed[False-True-True-False-False] 49.5210μs 18.1177μs 55.1947 KOps/s 56.1615 KOps/s $\color{#d91a1a}-1.72\%$
test_step_mdp_speed[False-True-False-True-True] 83.9420μs 49.7760μs 20.0900 KOps/s 20.1007 KOps/s $\color{#d91a1a}-0.05\%$
test_step_mdp_speed[False-True-False-True-False] 63.8320μs 31.5301μs 31.7157 KOps/s 31.5585 KOps/s $\color{#35bf28}+0.50\%$
test_step_mdp_speed[False-True-False-False-True] 65.5310μs 32.4571μs 30.8099 KOps/s 31.2122 KOps/s $\color{#d91a1a}-1.29\%$
test_step_mdp_speed[False-True-False-False-False] 42.1110μs 20.0762μs 49.8101 KOps/s 50.1733 KOps/s $\color{#d91a1a}-0.72\%$
test_step_mdp_speed[False-False-True-True-True] 93.0320μs 51.4825μs 19.4241 KOps/s 19.8945 KOps/s $\color{#d91a1a}-2.36\%$
test_step_mdp_speed[False-False-True-True-False] 61.1210μs 34.1692μs 29.2661 KOps/s 29.3074 KOps/s $\color{#d91a1a}-0.14\%$
test_step_mdp_speed[False-False-True-False-True] 66.9520μs 32.2339μs 31.0232 KOps/s 31.4202 KOps/s $\color{#d91a1a}-1.26\%$
test_step_mdp_speed[False-False-True-False-False] 44.8810μs 20.1914μs 49.5260 KOps/s 50.2078 KOps/s $\color{#d91a1a}-1.36\%$
test_step_mdp_speed[False-False-False-True-True] 87.1720μs 53.7385μs 18.6086 KOps/s 18.8847 KOps/s $\color{#d91a1a}-1.46\%$
test_step_mdp_speed[False-False-False-True-False] 69.6910μs 36.4669μs 27.4221 KOps/s 27.6548 KOps/s $\color{#d91a1a}-0.84\%$
test_step_mdp_speed[False-False-False-False-True] 65.2120μs 33.8728μs 29.5222 KOps/s 30.0012 KOps/s $\color{#d91a1a}-1.60\%$
test_step_mdp_speed[False-False-False-False-False] 52.4610μs 22.2504μs 44.9429 KOps/s 44.9565 KOps/s $\color{#d91a1a}-0.03\%$
test_values[generalized_advantage_estimate-True-True] 26.3255ms 25.7273ms 38.8692 Ops/s 39.6475 Ops/s $\color{#d91a1a}-1.96\%$
test_values[vec_generalized_advantage_estimate-True-True] 0.1059s 3.0314ms 329.8760 Ops/s 354.3848 Ops/s $\textbf{\color{#d91a1a}-6.92\%}$
test_values[td0_return_estimate-False-False] 0.1542ms 86.9365μs 11.5026 KOps/s 12.5977 KOps/s $\textbf{\color{#d91a1a}-8.69\%}$
test_values[td1_return_estimate-False-False] 60.2535ms 58.6108ms 17.0617 Ops/s 17.7777 Ops/s $\color{#d91a1a}-4.03\%$
test_values[vec_td1_return_estimate-False-False] 1.3568ms 1.1015ms 907.8787 Ops/s 919.4736 Ops/s $\color{#d91a1a}-1.26\%$
test_values[td_lambda_return_estimate-True-False] 95.3796ms 92.5850ms 10.8009 Ops/s 11.4089 Ops/s $\textbf{\color{#d91a1a}-5.33\%}$
test_values[vec_td_lambda_return_estimate-True-False] 1.3972ms 1.1040ms 905.8234 Ops/s 924.2525 Ops/s $\color{#d91a1a}-1.99\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 27.1754ms 26.5252ms 37.7001 Ops/s 40.5140 Ops/s $\textbf{\color{#d91a1a}-6.95\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.0584ms 0.7736ms 1.2927 KOps/s 1.3240 KOps/s $\color{#d91a1a}-2.36\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7266ms 0.6796ms 1.4714 KOps/s 1.4889 KOps/s $\color{#d91a1a}-1.18\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5644ms 1.5025ms 665.5579 Ops/s 667.0063 Ops/s $\color{#d91a1a}-0.22\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7662ms 0.7269ms 1.3757 KOps/s 1.4115 KOps/s $\color{#d91a1a}-2.54\%$
test_dqn_speed[False-None] 1.6661ms 1.5675ms 637.9645 Ops/s 651.2775 Ops/s $\color{#d91a1a}-2.04\%$
test_dqn_speed[False-backward] 2.2485ms 2.1902ms 456.5720 Ops/s 464.1865 Ops/s $\color{#d91a1a}-1.64\%$
test_dqn_speed[True-None] 0.6068ms 0.5574ms 1.7941 KOps/s 1.7102 KOps/s $\color{#35bf28}+4.91\%$
test_dqn_speed[True-backward] 1.2998ms 1.2424ms 804.8864 Ops/s 876.6595 Ops/s $\textbf{\color{#d91a1a}-8.19\%}$
test_dqn_speed[reduce-overhead-None] 0.6493ms 0.5754ms 1.7379 KOps/s 1.6779 KOps/s $\color{#35bf28}+3.58\%$
test_dqn_speed[reduce-overhead-backward] 1.1380ms 1.0815ms 924.6050 Ops/s 1.0239 KOps/s $\textbf{\color{#d91a1a}-9.69\%}$
test_ddpg_speed[False-None] 3.2546ms 2.9215ms 342.2888 Ops/s 348.6234 Ops/s $\color{#d91a1a}-1.82\%$
test_ddpg_speed[False-backward] 4.7843ms 4.3279ms 231.0570 Ops/s 238.3426 Ops/s $\color{#d91a1a}-3.06\%$
test_ddpg_speed[True-None] 1.4318ms 1.3579ms 736.4284 Ops/s 745.1810 Ops/s $\color{#d91a1a}-1.17\%$
test_ddpg_speed[True-backward] 2.6610ms 2.6268ms 380.6937 Ops/s 405.1892 Ops/s $\textbf{\color{#d91a1a}-6.05\%}$
test_ddpg_speed[reduce-overhead-None] 1.4999ms 1.3699ms 729.9740 Ops/s 735.5559 Ops/s $\color{#d91a1a}-0.76\%$
test_ddpg_speed[reduce-overhead-backward] 2.1183ms 2.0729ms 482.4049 Ops/s 507.0124 Ops/s $\color{#d91a1a}-4.85\%$
test_sac_speed[False-None] 8.7557ms 8.3245ms 120.1269 Ops/s 119.5685 Ops/s $\color{#35bf28}+0.47\%$
test_sac_speed[False-backward] 12.0409ms 11.5531ms 86.5566 Ops/s 89.1806 Ops/s $\color{#d91a1a}-2.94\%$
test_sac_speed[True-None] 2.0284ms 1.8650ms 536.1869 Ops/s 537.9462 Ops/s $\color{#d91a1a}-0.33\%$
test_sac_speed[True-backward] 3.9548ms 3.8629ms 258.8723 Ops/s 263.6077 Ops/s $\color{#d91a1a}-1.80\%$
test_sac_speed[reduce-overhead-None] 21.0734ms 11.9783ms 83.4843 Ops/s 80.9044 Ops/s $\color{#35bf28}+3.19\%$
test_sac_speed[reduce-overhead-backward] 1.8991ms 1.8105ms 552.3403 Ops/s 546.4504 Ops/s $\color{#35bf28}+1.08\%$
test_redq_speed[False-None] 9.3316ms 7.9161ms 126.3254 Ops/s 129.5973 Ops/s $\color{#d91a1a}-2.52\%$
test_redq_speed[False-backward] 12.6682ms 12.1728ms 82.1507 Ops/s 82.8247 Ops/s $\color{#d91a1a}-0.81\%$
test_redq_speed[True-None] 2.4257ms 2.3574ms 424.1923 Ops/s 422.7826 Ops/s $\color{#35bf28}+0.33\%$
test_redq_speed[True-backward] 4.5548ms 4.2760ms 233.8653 Ops/s 244.3201 Ops/s $\color{#d91a1a}-4.28\%$
test_redq_speed[reduce-overhead-None] 2.4906ms 2.3869ms 418.9468 Ops/s 421.6007 Ops/s $\color{#d91a1a}-0.63\%$
test_redq_speed[reduce-overhead-backward] 4.2979ms 4.1276ms 242.2692 Ops/s 229.9060 Ops/s $\textbf{\color{#35bf28}+5.38\%}$
test_redq_deprec_speed[False-None] 9.8872ms 9.3944ms 106.4461 Ops/s 109.0589 Ops/s $\color{#d91a1a}-2.40\%$
test_redq_deprec_speed[False-backward] 13.0046ms 12.4612ms 80.2494 Ops/s 80.1283 Ops/s $\color{#35bf28}+0.15\%$
test_redq_deprec_speed[True-None] 2.8231ms 2.6804ms 373.0782 Ops/s 373.5190 Ops/s $\color{#d91a1a}-0.12\%$
test_redq_deprec_speed[True-backward] 4.8828ms 4.4427ms 225.0899 Ops/s 216.0065 Ops/s $\color{#35bf28}+4.21\%$
test_redq_deprec_speed[reduce-overhead-None] 2.8597ms 2.6845ms 372.5034 Ops/s 366.0249 Ops/s $\color{#35bf28}+1.77\%$
test_redq_deprec_speed[reduce-overhead-backward] 4.9634ms 4.5016ms 222.1443 Ops/s 219.7393 Ops/s $\color{#35bf28}+1.09\%$
test_td3_speed[False-None] 8.6001ms 8.2396ms 121.3650 Ops/s 124.4495 Ops/s $\color{#d91a1a}-2.48\%$
test_td3_speed[False-backward] 11.2792ms 10.6520ms 93.8788 Ops/s 93.5679 Ops/s $\color{#35bf28}+0.33\%$
test_td3_speed[True-None] 1.6925ms 1.6640ms 600.9450 Ops/s 604.5724 Ops/s $\color{#d91a1a}-0.60\%$
test_td3_speed[True-backward] 3.3253ms 3.2564ms 307.0866 Ops/s 290.8267 Ops/s $\textbf{\color{#35bf28}+5.59\%}$
test_td3_speed[reduce-overhead-None] 78.8245ms 27.2491ms 36.6985 Ops/s 36.8968 Ops/s $\color{#d91a1a}-0.54\%$
test_td3_speed[reduce-overhead-backward] 1.4184ms 1.3482ms 741.7091 Ops/s 662.0496 Ops/s $\textbf{\color{#35bf28}+12.03\%}$
test_cql_speed[False-None] 17.7751ms 17.3001ms 57.8032 Ops/s 58.9397 Ops/s $\color{#d91a1a}-1.93\%$
test_cql_speed[False-backward] 22.9704ms 22.5919ms 44.2636 Ops/s 44.3516 Ops/s $\color{#d91a1a}-0.20\%$
test_cql_speed[True-None] 3.5683ms 3.4206ms 292.3432 Ops/s 304.0937 Ops/s $\color{#d91a1a}-3.86\%$
test_cql_speed[True-backward] 6.2930ms 5.8222ms 171.7556 Ops/s 176.2527 Ops/s $\color{#d91a1a}-2.55\%$
test_cql_speed[reduce-overhead-None] 0.5893s 16.4444ms 60.8109 Ops/s 73.9747 Ops/s $\textbf{\color{#d91a1a}-17.80\%}$
test_cql_speed[reduce-overhead-backward] 2.0863ms 2.0179ms 495.5742 Ops/s 526.0375 Ops/s $\textbf{\color{#d91a1a}-5.79\%}$
test_a2c_speed[False-None] 3.4799ms 3.3393ms 299.4663 Ops/s 304.9420 Ops/s $\color{#d91a1a}-1.80\%$
test_a2c_speed[False-backward] 7.3183ms 6.4837ms 154.2337 Ops/s 160.4482 Ops/s $\color{#d91a1a}-3.87\%$
test_a2c_speed[True-None] 1.5058ms 1.3794ms 724.9460 Ops/s 722.9985 Ops/s $\color{#35bf28}+0.27\%$
test_a2c_speed[True-backward] 3.2188ms 3.1357ms 318.9106 Ops/s 315.0912 Ops/s $\color{#35bf28}+1.21\%$
test_a2c_speed[reduce-overhead-None] 16.5425ms 9.1492ms 109.2993 Ops/s 107.2639 Ops/s $\color{#35bf28}+1.90\%$
test_a2c_speed[reduce-overhead-backward] 1.7236ms 1.6286ms 614.0305 Ops/s 602.2474 Ops/s $\color{#35bf28}+1.96\%$
test_ppo_speed[False-None] 3.9482ms 3.8031ms 262.9461 Ops/s 265.6675 Ops/s $\color{#d91a1a}-1.02\%$
test_ppo_speed[False-backward] 7.6132ms 7.2328ms 138.2599 Ops/s 139.7436 Ops/s $\color{#d91a1a}-1.06\%$
test_ppo_speed[True-None] 1.5510ms 1.4379ms 695.4600 Ops/s 677.2182 Ops/s $\color{#35bf28}+2.69\%$
test_ppo_speed[True-backward] 3.4350ms 3.3095ms 302.1646 Ops/s 300.6774 Ops/s $\color{#35bf28}+0.49\%$
test_ppo_speed[reduce-overhead-None] 1.0718ms 0.9851ms 1.0151 KOps/s 985.8479 Ops/s $\color{#35bf28}+2.97\%$
test_ppo_speed[reduce-overhead-backward] 1.6409ms 1.5790ms 633.2981 Ops/s 629.2431 Ops/s $\color{#35bf28}+0.64\%$
test_reinforce_speed[False-None] 2.4992ms 2.3378ms 427.7510 Ops/s 418.7899 Ops/s $\color{#35bf28}+2.14\%$
test_reinforce_speed[False-backward] 3.9696ms 3.5128ms 284.6713 Ops/s 283.0334 Ops/s $\color{#35bf28}+0.58\%$
test_reinforce_speed[True-None] 1.4329ms 1.3109ms 762.8353 Ops/s 762.1926 Ops/s $\color{#35bf28}+0.08\%$
test_reinforce_speed[True-backward] 3.1920ms 3.1513ms 317.3318 Ops/s 320.3166 Ops/s $\color{#d91a1a}-0.93\%$
test_reinforce_speed[reduce-overhead-None] 19.1177ms 10.5544ms 94.7476 Ops/s 93.0056 Ops/s $\color{#35bf28}+1.87\%$
test_reinforce_speed[reduce-overhead-backward] 1.7022ms 1.6539ms 604.6438 Ops/s 604.3550 Ops/s $\color{#35bf28}+0.05\%$
test_iql_speed[False-None] 9.9636ms 9.4704ms 105.5918 Ops/s 106.4152 Ops/s $\color{#d91a1a}-0.77\%$
test_iql_speed[False-backward] 13.8856ms 13.4462ms 74.3706 Ops/s 72.7829 Ops/s $\color{#35bf28}+2.18\%$
test_iql_speed[True-None] 2.5569ms 2.3033ms 434.1657 Ops/s 438.1394 Ops/s $\color{#d91a1a}-0.91\%$
test_iql_speed[True-backward] 5.5165ms 5.0936ms 196.3256 Ops/s 195.7870 Ops/s $\color{#35bf28}+0.28\%$
test_iql_speed[reduce-overhead-None] 0.5266s 13.3024ms 75.1746 Ops/s 87.1520 Ops/s $\textbf{\color{#d91a1a}-13.74\%}$
test_iql_speed[reduce-overhead-backward] 2.1581ms 2.0758ms 481.7400 Ops/s 470.7404 Ops/s $\color{#35bf28}+2.34\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.8869ms 6.4368ms 155.3577 Ops/s 155.6142 Ops/s $\color{#d91a1a}-0.16\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.4974ms 0.3033ms 3.2975 KOps/s 3.0090 KOps/s $\textbf{\color{#35bf28}+9.58\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5639ms 0.2947ms 3.3934 KOps/s 3.3991 KOps/s $\color{#d91a1a}-0.17\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.5086ms 6.1527ms 162.5291 Ops/s 163.9068 Ops/s $\color{#d91a1a}-0.84\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.1260ms 0.3087ms 3.2392 KOps/s 3.3076 KOps/s $\color{#d91a1a}-2.07\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6063ms 0.2878ms 3.4744 KOps/s 3.3330 KOps/s $\color{#35bf28}+4.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6323ms 1.3857ms 721.6616 Ops/s 691.1604 Ops/s $\color{#35bf28}+4.41\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6323ms 1.2942ms 772.6564 Ops/s 761.3952 Ops/s $\color{#35bf28}+1.48\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.4129ms 6.2838ms 159.1395 Ops/s 159.5882 Ops/s $\color{#d91a1a}-0.28\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.1162ms 0.4582ms 2.1826 KOps/s 2.0376 KOps/s $\textbf{\color{#35bf28}+7.12\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8090ms 0.3964ms 2.5230 KOps/s 2.5666 KOps/s $\color{#d91a1a}-1.70\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.3312ms 6.1743ms 161.9620 Ops/s 160.7336 Ops/s $\color{#35bf28}+0.76\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.8074ms 0.3855ms 2.5942 KOps/s 3.7504 KOps/s $\textbf{\color{#d91a1a}-30.83\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 1.2872ms 0.3679ms 2.7183 KOps/s 3.7418 KOps/s $\textbf{\color{#d91a1a}-27.35\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.4555ms 6.0720ms 164.6898 Ops/s 162.4039 Ops/s $\color{#35bf28}+1.41\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7519ms 0.3364ms 2.9724 KOps/s 3.1958 KOps/s $\textbf{\color{#d91a1a}-6.99\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5582ms 0.3139ms 3.1855 KOps/s 3.0783 KOps/s $\color{#35bf28}+3.48\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.6504ms 6.2945ms 158.8687 Ops/s 158.3913 Ops/s $\color{#35bf28}+0.30\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.8773ms 0.4618ms 2.1656 KOps/s 2.3292 KOps/s $\textbf{\color{#d91a1a}-7.03\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7699ms 0.4399ms 2.2733 KOps/s 2.5325 KOps/s $\textbf{\color{#d91a1a}-10.23\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 7.3015ms 5.6574ms 176.7599 Ops/s 173.5733 Ops/s $\color{#35bf28}+1.84\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 10.2640ms 2.1211ms 471.4529 Ops/s 432.2702 Ops/s $\textbf{\color{#35bf28}+9.06\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.7965ms 1.2521ms 798.6448 Ops/s 827.9803 Ops/s $\color{#d91a1a}-3.54\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 7.3875ms 5.8067ms 172.2140 Ops/s 172.5706 Ops/s $\color{#d91a1a}-0.21\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 10.6994ms 2.1905ms 456.5072 Ops/s 430.4338 Ops/s $\textbf{\color{#35bf28}+6.06\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 3.5408ms 1.1610ms 861.3519 Ops/s 835.7541 Ops/s $\color{#35bf28}+3.06\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.5179s 16.1951ms 61.7470 Ops/s 30.4921 Ops/s $\textbf{\color{#35bf28}+102.50\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 8.2027ms 2.1792ms 458.8743 Ops/s 496.1800 Ops/s $\textbf{\color{#d91a1a}-7.52\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 8.7249ms 1.3600ms 735.3015 Ops/s 821.5094 Ops/s $\textbf{\color{#d91a1a}-10.49\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 14.1010ms 13.6383ms 73.3232 Ops/s 71.4453 Ops/s $\color{#35bf28}+2.63\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 18.8377ms 17.0084ms 58.7943 Ops/s 59.0261 Ops/s $\color{#d91a1a}-0.39\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 18.8032ms 18.1032ms 55.2390 Ops/s 54.1198 Ops/s $\color{#35bf28}+2.07\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.0798ms 17.3006ms 57.8014 Ops/s 58.1124 Ops/s $\color{#d91a1a}-0.54\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 18.5567ms 18.1159ms 55.2001 Ops/s 54.1210 Ops/s $\color{#35bf28}+1.99\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.1035ms 18.7191ms 53.4213 Ops/s 54.6367 Ops/s $\color{#d91a1a}-2.22\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot