[Benchmark] Benchmark split and chunk (#564) #341
Annotations
2 errors and 2 warnings
Python Setup
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
|
Store benchmark results
# :warning: **Performance Alert** :warning:
Possible performance regression was detected for benchmark **'GPU Benchmark Results'**.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`.
| Benchmark suite | Current: a5bed018f3e589ea4e0c4e5321a165362a440a75 | Previous: e1f20f4722934c9dc7ebb8d75e2d898a29b57edf | Ratio |
|-|-|-|-|
| `benchmarks/common/common_ops_test.py::test_keys_nested_leaf` | `6012.397478118437` iter/sec (`stddev: 0.000003872820935640608`) | `12214.349670374433` iter/sec (`stddev: 0.000002600991620871067`) | `2.03` |
| `benchmarks/nn/functional_benchmarks_test.py::test_tdmodule` | `11796.69315175139` iter/sec (`stddev: 0.0018184055517336617`) | `58064.722529576306` iter/sec (`stddev: 0.0000010512503394212976`) | `4.92` |
This comment was automatically generated by [workflow](https://github.com/pytorch/tensordict/actions?query=workflow%3AContinuous%20Benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
CC: @vmoens
Comment was generated at https://github.com/pytorch/tensordict/commit/a5bed018f3e589ea4e0c4e5321a165362a440a75#commitcomment-133146812
|
Store benchmark results
Performance alert! Previous value was 12214.349670374433 and current value is 6012.397478118437. It is 2.031527309168668x worse than previous exceeding a ratio threshold 2
|
Store benchmark results
Performance alert! Previous value was 58064.722529576306 and current value is 11796.69315175139. It is 4.922118578709981x worse than previous exceeding a ratio threshold 2
|
The logs for this run have expired and are no longer available.
Loading