Skip to content

[Feature] Make benchmarked losses compatible with torch.compile #6703

[Feature] Make benchmarked losses compatible with torch.compile

[Feature] Make benchmarked losses compatible with torch.compile #6703

Triggered via push September 17, 2024 02:59
Status Failure
Total duration 17m 18s
Artifacts

benchmarks.yml

on: push
CPU Pytest benchmark
15m 55s
CPU Pytest benchmark
GPU Pytest benchmark
17m 7s
GPU Pytest benchmark
Fit to window
Zoom out
Zoom in

Annotations

4 errors and 3 warnings
CPU Pytest benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'CPU Benchmark Results'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: 2332909acb7c56393f6b080020b753d7f18aa9b7 | Previous: 605b4aabe1637151580bbf45e4ebcf13bb286aca | Ratio | |-|-|-|-| | `benchmarks/test_replaybuffer_benchmark.py::test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]` | `30.183476406713112` iter/sec (`stddev: 0.20221241229003356`) | `157.5775708449948` iter/sec (`stddev: 0.016796232595089552`) | `5.22` | This comment was automatically generated by [workflow](https://github.com/pytorch/rl/actions?query=workflow%3AContinuous%20Benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @vmoens Comment was generated at https://github.com/pytorch/rl/commit/2332909acb7c56393f6b080020b753d7f18aa9b7#commitcomment-146798021
GPU Pytest benchmark
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
GPU Pytest benchmark
WARNING: The directory '/github/home/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
GPU Pytest benchmark
Process completed with exit code 1.
CPU Pytest benchmark
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3, actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
CPU Pytest benchmark
Performance alert! Previous value was 157.5775708449948 and current value is 30.183476406713112. It is 5.220656783257343x worse than previous exceeding a ratio threshold 2
GPU Pytest benchmark
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.