⚠ This page is served via a proxy. Original site: https://github.com
This service does not collect credentials or authentication data.
Skip to content

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Dec 31, 2025

Stack from ghstack (oldest at bottom):

[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Dec 31, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3286

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Unrelated Failures

As of commit 9df6d74 with merge base 3ab4b30 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

vmoens added a commit that referenced this pull request Dec 31, 2025
ghstack-source-id: 2e1839f
Pull-Request: #3286
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 31, 2025
@github-actions
Copy link

github-actions bot commented Dec 31, 2025

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}22$. Worsened: $\large\color{#d91a1a}10$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 81.2446μs 80.5031μs 12.4219 KOps/s 12.4286 KOps/s $\color{#d91a1a}-0.05\%$
test_tensor_to_bytestream_speed[torch.save] 0.1397ms 0.1385ms 7.2194 KOps/s 7.2077 KOps/s $\color{#35bf28}+0.16\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1092s 0.1088s 9.1907 Ops/s 8.5398 Ops/s $\textbf{\color{#35bf28}+7.62\%}$
test_tensor_to_bytestream_speed[numpy] 2.6674μs 2.6530μs 376.9334 KOps/s 378.5072 KOps/s $\color{#d91a1a}-0.42\%$
test_tensor_to_bytestream_speed[safetensors] 39.2676μs 39.0517μs 25.6071 KOps/s 26.8797 KOps/s $\color{#d91a1a}-4.73\%$
test_simple 0.5475s 0.5423s 1.8440 Ops/s 1.7764 Ops/s $\color{#35bf28}+3.80\%$
test_transformed 1.1061s 1.1015s 0.9079 Ops/s 0.8902 Ops/s $\color{#35bf28}+1.99\%$
test_serial 1.6658s 1.6570s 0.6035 Ops/s 0.6048 Ops/s $\color{#d91a1a}-0.22\%$
test_parallel 1.0708s 1.0633s 0.9405 Ops/s 0.8928 Ops/s $\textbf{\color{#35bf28}+5.35\%}$
test_step_mdp_speed[True-True-True-True-True] 0.1931ms 42.8659μs 23.3286 KOps/s 23.2226 KOps/s $\color{#35bf28}+0.46\%$
test_step_mdp_speed[True-True-True-True-False] 56.4930μs 24.4740μs 40.8597 KOps/s 41.0874 KOps/s $\color{#d91a1a}-0.55\%$
test_step_mdp_speed[True-True-True-False-True] 57.5530μs 24.6590μs 40.5532 KOps/s 40.8020 KOps/s $\color{#d91a1a}-0.61\%$
test_step_mdp_speed[True-True-True-False-False] 42.6720μs 13.5383μs 73.8644 KOps/s 74.9220 KOps/s $\color{#d91a1a}-1.41\%$
test_step_mdp_speed[True-True-False-True-True] 80.5630μs 46.6053μs 21.4568 KOps/s 21.6044 KOps/s $\color{#d91a1a}-0.68\%$
test_step_mdp_speed[True-True-False-True-False] 87.3140μs 26.3782μs 37.9101 KOps/s 37.2311 KOps/s $\color{#35bf28}+1.82\%$
test_step_mdp_speed[True-True-False-False-True] 56.0320μs 27.4200μs 36.4698 KOps/s 37.5995 KOps/s $\color{#d91a1a}-3.00\%$
test_step_mdp_speed[True-True-False-False-False] 50.2720μs 16.4100μs 60.9383 KOps/s 61.9578 KOps/s $\color{#d91a1a}-1.65\%$
test_step_mdp_speed[True-False-True-True-True] 90.4440μs 49.5010μs 20.2016 KOps/s 20.4614 KOps/s $\color{#d91a1a}-1.27\%$
test_step_mdp_speed[True-False-True-True-False] 60.2520μs 30.4211μs 32.8719 KOps/s 33.7648 KOps/s $\color{#d91a1a}-2.64\%$
test_step_mdp_speed[True-False-True-False-True] 57.0120μs 27.1183μs 36.8754 KOps/s 36.7352 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[True-False-True-False-False] 43.3520μs 16.0435μs 62.3305 KOps/s 61.5691 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[True-False-False-True-True] 89.0640μs 50.7055μs 19.7217 KOps/s 19.6750 KOps/s $\color{#35bf28}+0.24\%$
test_step_mdp_speed[True-False-False-True-False] 64.2030μs 32.7212μs 30.5612 KOps/s 30.8876 KOps/s $\color{#d91a1a}-1.06\%$
test_step_mdp_speed[True-False-False-False-True] 77.2240μs 29.8641μs 33.4851 KOps/s 34.0782 KOps/s $\color{#d91a1a}-1.74\%$
test_step_mdp_speed[True-False-False-False-False] 55.6120μs 18.9133μs 52.8728 KOps/s 54.0119 KOps/s $\color{#d91a1a}-2.11\%$
test_step_mdp_speed[False-True-True-True-True] 84.8340μs 49.6184μs 20.1538 KOps/s 20.2237 KOps/s $\color{#d91a1a}-0.35\%$
test_step_mdp_speed[False-True-True-True-False] 64.2930μs 29.9517μs 33.3871 KOps/s 33.4642 KOps/s $\color{#d91a1a}-0.23\%$
test_step_mdp_speed[False-True-True-False-True] 2.4446ms 31.4098μs 31.8372 KOps/s 33.0646 KOps/s $\color{#d91a1a}-3.71\%$
test_step_mdp_speed[False-True-True-False-False] 56.9920μs 18.0366μs 55.4427 KOps/s 56.5256 KOps/s $\color{#d91a1a}-1.92\%$
test_step_mdp_speed[False-True-False-True-True] 86.9730μs 52.0325μs 19.2188 KOps/s 19.5958 KOps/s $\color{#d91a1a}-1.92\%$
test_step_mdp_speed[False-True-False-True-False] 70.3840μs 32.4353μs 30.8306 KOps/s 31.0031 KOps/s $\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-True-False-False-True] 65.5630μs 33.2779μs 30.0499 KOps/s 31.0016 KOps/s $\color{#d91a1a}-3.07\%$
test_step_mdp_speed[False-True-False-False-False] 53.0920μs 20.7476μs 48.1983 KOps/s 49.2524 KOps/s $\color{#d91a1a}-2.14\%$
test_step_mdp_speed[False-False-True-True-True] 85.0140μs 54.5960μs 18.3164 KOps/s 18.8390 KOps/s $\color{#d91a1a}-2.77\%$
test_step_mdp_speed[False-False-True-True-False] 66.9530μs 35.4429μs 28.2144 KOps/s 28.4041 KOps/s $\color{#d91a1a}-0.67\%$
test_step_mdp_speed[False-False-True-False-True] 65.8330μs 33.1946μs 30.1254 KOps/s 30.6674 KOps/s $\color{#d91a1a}-1.77\%$
test_step_mdp_speed[False-False-True-False-False] 57.4530μs 20.7858μs 48.1098 KOps/s 48.8959 KOps/s $\color{#d91a1a}-1.61\%$
test_step_mdp_speed[False-False-False-True-True] 90.5040μs 57.2448μs 17.4688 KOps/s 18.0272 KOps/s $\color{#d91a1a}-3.10\%$
test_step_mdp_speed[False-False-False-True-False] 0.1246ms 37.3484μs 26.7749 KOps/s 26.8029 KOps/s $\color{#d91a1a}-0.10\%$
test_step_mdp_speed[False-False-False-False-True] 71.3930μs 35.3700μs 28.2726 KOps/s 28.7136 KOps/s $\color{#d91a1a}-1.54\%$
test_step_mdp_speed[False-False-False-False-False] 55.3420μs 22.9146μs 43.6403 KOps/s 44.4792 KOps/s $\color{#d91a1a}-1.89\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.8560s 0.7570s 1.3210 Ops/s 1.3257 Ops/s $\color{#d91a1a}-0.36\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7162s 0.6186s 1.6164 Ops/s 1.6219 Ops/s $\color{#d91a1a}-0.34\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7432s 1.6635s 0.6012 Ops/s 0.6089 Ops/s $\color{#d91a1a}-1.27\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5241s 1.4405s 0.6942 Ops/s 0.7010 Ops/s $\color{#d91a1a}-0.97\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 1.9903s 1.8917s 0.5286 Ops/s 0.5319 Ops/s $\color{#d91a1a}-0.62\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.7784s 1.6861s 0.5931 Ops/s 0.6004 Ops/s $\color{#d91a1a}-1.21\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.7242s 4.5766s 0.2185 Ops/s 0.2172 Ops/s $\color{#35bf28}+0.60\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.4945s 4.3902s 0.2278 Ops/s 0.2273 Ops/s $\color{#35bf28}+0.22\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.0629s 1.9662s 0.5086 Ops/s 0.5111 Ops/s $\color{#d91a1a}-0.49\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.7223s 1.6505s 0.6059 Ops/s 0.6078 Ops/s $\color{#d91a1a}-0.32\%$
test_values[generalized_advantage_estimate-True-True] 10.0997ms 9.7672ms 102.3838 Ops/s 100.0189 Ops/s $\color{#35bf28}+2.36\%$
test_values[vec_generalized_advantage_estimate-True-True] 17.3627ms 11.1379ms 89.7837 Ops/s 91.1373 Ops/s $\color{#d91a1a}-1.49\%$
test_values[td0_return_estimate-False-False] 0.2115ms 0.1222ms 8.1857 KOps/s 7.1432 KOps/s $\textbf{\color{#35bf28}+14.59\%}$
test_values[td1_return_estimate-False-False] 26.9817ms 25.7476ms 38.8386 Ops/s 37.1067 Ops/s $\color{#35bf28}+4.67\%$
test_values[vec_td1_return_estimate-False-False] 11.2570ms 10.9184ms 91.5882 Ops/s 91.5048 Ops/s $\color{#35bf28}+0.09\%$
test_values[td_lambda_return_estimate-True-False] 40.0492ms 38.3659ms 26.0648 Ops/s 25.4253 Ops/s $\color{#35bf28}+2.52\%$
test_values[vec_td_lambda_return_estimate-True-False] 11.2516ms 10.9573ms 91.2637 Ops/s 90.4865 Ops/s $\color{#35bf28}+0.86\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.6267ms 8.5211ms 117.3552 Ops/s 112.7061 Ops/s $\color{#35bf28}+4.12\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.6554ms 1.4624ms 683.8246 Ops/s 688.1632 Ops/s $\color{#d91a1a}-0.63\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4371ms 0.3953ms 2.5299 KOps/s 2.4334 KOps/s $\color{#35bf28}+3.97\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 34.8871ms 33.5836ms 29.7764 Ops/s 43.0843 Ops/s $\textbf{\color{#d91a1a}-30.89\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 2.1047ms 1.6949ms 589.9921 Ops/s 591.9892 Ops/s $\color{#d91a1a}-0.34\%$
test_dqn_speed[False-None] 1.5883ms 1.3569ms 736.9480 Ops/s 741.2406 Ops/s $\color{#d91a1a}-0.58\%$
test_dqn_speed[False-backward] 1.9438ms 1.8575ms 538.3618 Ops/s 538.7748 Ops/s $\color{#d91a1a}-0.08\%$
test_dqn_speed[True-None] 0.8883ms 0.5294ms 1.8891 KOps/s 1.9017 KOps/s $\color{#d91a1a}-0.66\%$
test_dqn_speed[True-backward] 0.9900ms 0.9550ms 1.0472 KOps/s 943.7447 Ops/s $\textbf{\color{#35bf28}+10.96\%}$
test_dqn_speed[reduce-overhead-None] 0.7555ms 0.5233ms 1.9109 KOps/s 1.8709 KOps/s $\color{#35bf28}+2.14\%$
test_dqn_speed[reduce-overhead-backward] 0.9892ms 0.9510ms 1.0515 KOps/s 894.2595 Ops/s $\textbf{\color{#35bf28}+17.59\%}$
test_ddpg_speed[False-None] 3.0900ms 2.8091ms 355.9880 Ops/s 345.3258 Ops/s $\color{#35bf28}+3.09\%$
test_ddpg_speed[False-backward] 4.3683ms 4.0033ms 249.7965 Ops/s 247.5566 Ops/s $\color{#35bf28}+0.90\%$
test_ddpg_speed[True-None] 1.5345ms 1.3764ms 726.5300 Ops/s 697.0808 Ops/s $\color{#35bf28}+4.22\%$
test_ddpg_speed[True-backward] 2.4032ms 2.3214ms 430.7749 Ops/s 408.9420 Ops/s $\textbf{\color{#35bf28}+5.34\%}$
test_ddpg_speed[reduce-overhead-None] 1.6056ms 1.3522ms 739.5473 Ops/s 726.6939 Ops/s $\color{#35bf28}+1.77\%$
test_ddpg_speed[reduce-overhead-backward] 2.3562ms 2.3035ms 434.1270 Ops/s 419.3173 Ops/s $\color{#35bf28}+3.53\%$
test_sac_speed[False-None] 8.3164ms 7.7526ms 128.9895 Ops/s 128.2425 Ops/s $\color{#35bf28}+0.58\%$
test_sac_speed[False-backward] 11.4263ms 10.8945ms 91.7891 Ops/s 90.7669 Ops/s $\color{#35bf28}+1.13\%$
test_sac_speed[True-None] 2.4673ms 2.0877ms 478.9934 Ops/s 473.0572 Ops/s $\color{#35bf28}+1.25\%$
test_sac_speed[True-backward] 4.0996ms 4.0027ms 249.8325 Ops/s 236.8441 Ops/s $\textbf{\color{#35bf28}+5.48\%}$
test_sac_speed[reduce-overhead-None] 2.5406ms 2.0939ms 477.5838 Ops/s 463.0678 Ops/s $\color{#35bf28}+3.13\%$
test_sac_speed[reduce-overhead-backward] 4.0077ms 3.9188ms 255.1772 Ops/s 249.9325 Ops/s $\color{#35bf28}+2.10\%$
test_redq_speed[False-None] 10.7814ms 10.1409ms 98.6108 Ops/s 70.1185 Ops/s $\textbf{\color{#35bf28}+40.63\%}$
test_redq_speed[False-backward] 18.1056ms 17.3873ms 57.5132 Ops/s 58.1895 Ops/s $\color{#d91a1a}-1.16\%$
test_redq_speed[True-None] 4.8365ms 4.3375ms 230.5454 Ops/s 232.2863 Ops/s $\color{#d91a1a}-0.75\%$
test_redq_speed[True-backward] 10.0250ms 9.7558ms 102.5030 Ops/s 105.8985 Ops/s $\color{#d91a1a}-3.21\%$
test_redq_speed[reduce-overhead-None] 6.2992ms 4.4651ms 223.9596 Ops/s 235.7938 Ops/s $\textbf{\color{#d91a1a}-5.02\%}$
test_redq_speed[reduce-overhead-backward] 10.2962ms 9.8206ms 101.8271 Ops/s 104.5805 Ops/s $\color{#d91a1a}-2.63\%$
test_redq_deprec_speed[False-None] 11.4809ms 10.9159ms 91.6096 Ops/s 89.2315 Ops/s $\color{#35bf28}+2.67\%$
test_redq_deprec_speed[False-backward] 16.0100ms 15.6578ms 63.8660 Ops/s 61.3464 Ops/s $\color{#35bf28}+4.11\%$
test_redq_deprec_speed[True-None] 3.9913ms 3.5904ms 278.5181 Ops/s 262.4376 Ops/s $\textbf{\color{#35bf28}+6.13\%}$
test_redq_deprec_speed[True-backward] 7.7187ms 7.4936ms 133.4469 Ops/s 121.0011 Ops/s $\textbf{\color{#35bf28}+10.29\%}$
test_redq_deprec_speed[reduce-overhead-None] 3.9820ms 3.5729ms 279.8844 Ops/s 254.8963 Ops/s $\textbf{\color{#35bf28}+9.80\%}$
test_redq_deprec_speed[reduce-overhead-backward] 7.6467ms 7.4715ms 133.8423 Ops/s 120.6695 Ops/s $\textbf{\color{#35bf28}+10.92\%}$
test_td3_speed[False-None] 7.8699ms 7.8095ms 128.0499 Ops/s 128.4026 Ops/s $\color{#d91a1a}-0.27\%$
test_td3_speed[False-backward] 11.2737ms 10.6192ms 94.1693 Ops/s 94.5757 Ops/s $\color{#d91a1a}-0.43\%$
test_td3_speed[True-None] 1.8360ms 1.8020ms 554.9532 Ops/s 539.4314 Ops/s $\color{#35bf28}+2.88\%$
test_td3_speed[True-backward] 3.7845ms 3.5757ms 279.6649 Ops/s 279.9369 Ops/s $\color{#d91a1a}-0.10\%$
test_td3_speed[reduce-overhead-None] 1.8293ms 1.7828ms 560.9098 Ops/s 561.8925 Ops/s $\color{#d91a1a}-0.17\%$
test_td3_speed[reduce-overhead-backward] 4.9528ms 3.6425ms 274.5364 Ops/s 252.9308 Ops/s $\textbf{\color{#35bf28}+8.54\%}$
test_cql_speed[False-None] 29.7601ms 25.9767ms 38.4961 Ops/s 39.4322 Ops/s $\color{#d91a1a}-2.37\%$
test_cql_speed[False-backward] 39.8073ms 35.1063ms 28.4849 Ops/s 27.9500 Ops/s $\color{#35bf28}+1.91\%$
test_cql_speed[True-None] 12.6327ms 12.1541ms 82.2768 Ops/s 81.0119 Ops/s $\color{#35bf28}+1.56\%$
test_cql_speed[True-backward] 18.4738ms 18.0652ms 55.3550 Ops/s 54.6145 Ops/s $\color{#35bf28}+1.36\%$
test_cql_speed[reduce-overhead-None] 12.8445ms 12.3179ms 81.1824 Ops/s 78.9975 Ops/s $\color{#35bf28}+2.77\%$
test_cql_speed[reduce-overhead-backward] 18.5053ms 18.0842ms 55.2968 Ops/s 52.3920 Ops/s $\textbf{\color{#35bf28}+5.54\%}$
test_a2c_speed[False-None] 5.5531ms 5.3437ms 187.1352 Ops/s 181.9297 Ops/s $\color{#35bf28}+2.86\%$
test_a2c_speed[False-backward] 12.0713ms 11.6758ms 85.6471 Ops/s 85.1656 Ops/s $\color{#35bf28}+0.57\%$
test_a2c_speed[True-None] 4.0405ms 3.7116ms 269.4280 Ops/s 257.8418 Ops/s $\color{#35bf28}+4.49\%$
test_a2c_speed[True-backward] 8.8123ms 8.5340ms 117.1779 Ops/s 115.1787 Ops/s $\color{#35bf28}+1.74\%$
test_a2c_speed[reduce-overhead-None] 4.0028ms 3.6628ms 273.0150 Ops/s 268.0265 Ops/s $\color{#35bf28}+1.86\%$
test_a2c_speed[reduce-overhead-backward] 8.7676ms 8.5931ms 116.3726 Ops/s 111.0742 Ops/s $\color{#35bf28}+4.77\%$
test_ppo_speed[False-None] 6.1621ms 5.7894ms 172.7290 Ops/s 167.6975 Ops/s $\color{#35bf28}+3.00\%$
test_ppo_speed[False-backward] 12.7878ms 12.2378ms 81.7140 Ops/s 80.4946 Ops/s $\color{#35bf28}+1.51\%$
test_ppo_speed[True-None] 3.6903ms 3.5307ms 283.2264 Ops/s 273.4662 Ops/s $\color{#35bf28}+3.57\%$
test_ppo_speed[True-backward] 8.5016ms 8.2995ms 120.4892 Ops/s 120.2266 Ops/s $\color{#35bf28}+0.22\%$
test_ppo_speed[reduce-overhead-None] 3.8163ms 3.5444ms 282.1382 Ops/s 272.0119 Ops/s $\color{#35bf28}+3.72\%$
test_ppo_speed[reduce-overhead-backward] 8.9153ms 8.6508ms 115.5959 Ops/s 114.7633 Ops/s $\color{#35bf28}+0.73\%$
test_reinforce_speed[False-None] 4.8744ms 4.5452ms 220.0134 Ops/s 213.7634 Ops/s $\color{#35bf28}+2.92\%$
test_reinforce_speed[False-backward] 7.5992ms 7.3063ms 136.8685 Ops/s 132.2943 Ops/s $\color{#35bf28}+3.46\%$
test_reinforce_speed[True-None] 3.1422ms 2.8187ms 354.7772 Ops/s 344.7004 Ops/s $\color{#35bf28}+2.92\%$
test_reinforce_speed[True-backward] 7.8703ms 7.6166ms 131.2923 Ops/s 128.8970 Ops/s $\color{#35bf28}+1.86\%$
test_reinforce_speed[reduce-overhead-None] 3.1421ms 2.8160ms 355.1198 Ops/s 343.0535 Ops/s $\color{#35bf28}+3.52\%$
test_reinforce_speed[reduce-overhead-backward] 8.0841ms 7.8001ms 128.2038 Ops/s 118.7997 Ops/s $\textbf{\color{#35bf28}+7.92\%}$
test_iql_speed[False-None] 26.4680ms 20.0027ms 49.9934 Ops/s 50.1575 Ops/s $\color{#d91a1a}-0.33\%$
test_iql_speed[False-backward] 31.1422ms 29.8547ms 33.4955 Ops/s 33.3750 Ops/s $\color{#35bf28}+0.36\%$
test_iql_speed[True-None] 8.6340ms 8.3669ms 119.5180 Ops/s 116.5886 Ops/s $\color{#35bf28}+2.51\%$
test_iql_speed[True-backward] 16.9140ms 16.5244ms 60.5167 Ops/s 59.7792 Ops/s $\color{#35bf28}+1.23\%$
test_iql_speed[reduce-overhead-None] 8.7271ms 8.4469ms 118.3872 Ops/s 115.1900 Ops/s $\color{#35bf28}+2.78\%$
test_iql_speed[reduce-overhead-backward] 17.4186ms 16.9611ms 58.9583 Ops/s 58.4688 Ops/s $\color{#35bf28}+0.84\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.1740ms 5.8299ms 171.5297 Ops/s 170.1345 Ops/s $\color{#35bf28}+0.82\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7128ms 0.3801ms 2.6311 KOps/s 3.2290 KOps/s $\textbf{\color{#d91a1a}-18.52\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5955ms 0.3710ms 2.6953 KOps/s 3.4181 KOps/s $\textbf{\color{#d91a1a}-21.15\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.8345ms 5.5912ms 178.8536 Ops/s 178.4314 Ops/s $\color{#35bf28}+0.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.2682ms 0.3706ms 2.6987 KOps/s 2.9398 KOps/s $\textbf{\color{#d91a1a}-8.20\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6170ms 0.3541ms 2.8241 KOps/s 3.1200 KOps/s $\textbf{\color{#d91a1a}-9.48\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6489ms 1.4157ms 706.3528 Ops/s 722.2049 Ops/s $\color{#d91a1a}-2.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6317ms 1.3360ms 748.4778 Ops/s 770.6627 Ops/s $\color{#d91a1a}-2.88\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.4168ms 5.8641ms 170.5281 Ops/s 174.3752 Ops/s $\color{#d91a1a}-2.21\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.9383ms 0.5208ms 1.9203 KOps/s 2.0628 KOps/s $\textbf{\color{#d91a1a}-6.91\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7309ms 0.5084ms 1.9668 KOps/s 2.0625 KOps/s $\color{#d91a1a}-4.64\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.6804ms 5.6037ms 178.4545 Ops/s 177.8634 Ops/s $\color{#35bf28}+0.33\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.9810ms 0.3448ms 2.8999 KOps/s 2.9454 KOps/s $\color{#d91a1a}-1.55\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5393ms 0.3270ms 3.0581 KOps/s 3.1100 KOps/s $\color{#d91a1a}-1.67\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.8108ms 5.5780ms 179.2764 Ops/s 178.9873 Ops/s $\color{#35bf28}+0.16\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.9258ms 0.3645ms 2.7431 KOps/s 2.8089 KOps/s $\color{#d91a1a}-2.34\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5247ms 0.2605ms 3.8387 KOps/s 2.8934 KOps/s $\textbf{\color{#35bf28}+32.67\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.8307ms 5.7385ms 174.2624 Ops/s 171.9770 Ops/s $\color{#35bf28}+1.33\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0564ms 0.4269ms 2.3422 KOps/s 2.0850 KOps/s $\textbf{\color{#35bf28}+12.34\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6560ms 0.4398ms 2.2737 KOps/s 2.1457 KOps/s $\textbf{\color{#35bf28}+5.96\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.6348s 17.5111ms 57.1066 Ops/s 189.0195 Ops/s $\textbf{\color{#d91a1a}-69.79\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 11.9438ms 1.8405ms 543.3316 Ops/s 574.5675 Ops/s $\textbf{\color{#d91a1a}-5.44\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1320ms 0.8944ms 1.1180 KOps/s 779.6730 Ops/s $\textbf{\color{#35bf28}+43.40\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 6.3674ms 4.9151ms 203.4527 Ops/s 200.4361 Ops/s $\color{#35bf28}+1.50\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 13.2716ms 2.0105ms 497.3885 Ops/s 590.2664 Ops/s $\textbf{\color{#d91a1a}-15.73\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.7849ms 1.2050ms 829.8512 Ops/s 784.8498 Ops/s $\textbf{\color{#35bf28}+5.73\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.5983s 17.0115ms 58.7839 Ops/s 53.2400 Ops/s $\textbf{\color{#35bf28}+10.41\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 3.9600ms 1.8533ms 539.5767 Ops/s 523.8910 Ops/s $\color{#35bf28}+2.99\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.2458ms 1.2177ms 821.2336 Ops/s 722.7033 Ops/s $\textbf{\color{#35bf28}+13.63\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 38.1523ms 35.3252ms 28.3084 Ops/s 27.9982 Ops/s $\color{#35bf28}+1.11\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.2586ms 17.3770ms 57.5474 Ops/s 56.5511 Ops/s $\color{#35bf28}+1.76\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 38.5410ms 36.1954ms 27.6278 Ops/s 27.1401 Ops/s $\color{#35bf28}+1.80\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.4587ms 17.6407ms 56.6872 Ops/s 55.8983 Ops/s $\color{#35bf28}+1.41\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 40.9514ms 38.6628ms 25.8647 Ops/s 26.1026 Ops/s $\color{#d91a1a}-0.91\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.3483ms 19.0175ms 52.5830 Ops/s 52.6156 Ops/s $\color{#d91a1a}-0.06\%$

@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Dec 31, 2025
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 31, 2025
ghstack-source-id: 7c92a6d
Pull-Request: #3286
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 31, 2025
ghstack-source-id: d5fae60
Pull-Request: #3286
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Jan 1, 2026
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 1, 2026
ghstack-source-id: 34cd3ab
Pull-Request: #3286

amend

ghstack-source-id: 34cd3ab
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 1, 2026
ghstack-source-id: b6179e0
Pull-Request: #3286

amend

ghstack-source-id: b6179e0
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 8379fda
Pull-Request: #3286

amend

ghstack-source-id: 8379fda
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 535577c
Pull-Request: #3286

amend

ghstack-source-id: 535577c
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: fc83efd
Pull-Request: #3286

amend

ghstack-source-id: fc83efd
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 5eaa840
Pull-Request: #3286

amend

ghstack-source-id: 5eaa840
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 962c34a
Pull-Request: #3286

amend

ghstack-source-id: 962c34a
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: d98ab44
Pull-Request: #3286

amend

ghstack-source-id: d98ab44
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 70a9cf1
Pull-Request: #3286

amend

ghstack-source-id: 70a9cf1
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: ad7fceb
Pull-Request: #3286

amend

ghstack-source-id: ad7fceb
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: e497e7b
Pull-Request: #3286

amend

ghstack-source-id: e497e7b
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: ef9bd91
Pull-Request: #3286

amend

ghstack-source-id: ef9bd91
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 15, 2026
ghstack-source-id: 6310763
Pull-Request: #3286

amend

ghstack-source-id: 6310763
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 15, 2026
ghstack-source-id: 5bfa605
Pull-Request: #3286

amend

ghstack-source-id: 5bfa605
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 15, 2026
ghstack-source-id: 9c4adbd
Pull-Request: #3286

amend

ghstack-source-id: 9c4adbd
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 15, 2026
ghstack-source-id: 5938227
Pull-Request: #3286

amend

ghstack-source-id: 5938227
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 16, 2026
ghstack-source-id: 3d7e92c
Pull-Request: #3286

amend

ghstack-source-id: 3d7e92c
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 16, 2026
ghstack-source-id: 5ae2167
Pull-Request: #3286

amend

ghstack-source-id: 5ae2167
Pull-Request: #3287
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants