Skip to content

Examine slow metrics computation #1336

Closed
Mr-Geekman opened this issue Jul 27, 2023 · 0 comments · Fixed by #1338
Closed

Examine slow metrics computation #1336

Mr-Geekman opened this issue Jul 27, 2023 · 0 comments · Fixed by #1338
Assignees
Labels
enhancement New feature or request priority/high High priority task

Comments

@Mr-Geekman
Copy link
Contributor

Mr-Geekman commented Jul 27, 2023

🚀 Feature Request

Currently in some backtesting pipelines the bottleneck could be a metric computation. It isn't a good situation. We should discover why is it happening.

Proposal

We should try to understand why metrics are computed very slow for a big number of segments.

The problem probably lies in per-segment metric computation. We could compute it more optimally, but our current Metric implementation isn't suited for that: it is very strict about how metric is computed using metric_fn. Probably, we could significantly improve even this kind of computation if we could iterate over segments more optimally.

Steps:

  • Profile metric computation for different number of segments and features;
  • Find out what place is bottleneck;
  • Describe the problem in the comments of the issue.

Test cases

No response

Additional context

No response

@Mr-Geekman Mr-Geekman added enhancement New feature or request priority/high High priority task labels Jul 27, 2023
@github-project-automation github-project-automation bot moved this to Specification in etna board Jul 27, 2023
@Mr-Geekman Mr-Geekman changed the title Speed up metrics computation Examin speeding up metrics computation Jul 27, 2023
@Mr-Geekman Mr-Geekman changed the title Examin speeding up metrics computation Examine speeding up metrics computation Jul 27, 2023
@Mr-Geekman Mr-Geekman changed the title Examine speeding up metrics computation Examine slow metrics computation Jul 27, 2023
@Mr-Geekman Mr-Geekman moved this from Specification to In Review in etna board Jul 28, 2023
@Mr-Geekman Mr-Geekman self-assigned this Jul 28, 2023
@github-project-automation github-project-automation bot moved this from In Review to Done in etna board Aug 1, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request priority/high High priority task
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

1 participant