Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tests: add world load benchmark #2768

Merged
merged 4 commits into from
Feb 4, 2024
Merged

Tests: add world load benchmark #2768

merged 4 commits into from
Feb 4, 2024

Conversation

Berserker66
Copy link
Member

What is this fixing or adding?

adds a world load time benchmark and reshuffles the benchmark directory to allow running all benchmarks or locations or world load time

How was this tested?

locally

If this makes graphical changes, please attach screenshots.

@Jarno458 Jarno458 added is: enhancement Issues requesting new features or pull requests implementing new features. affects: core Issues/PRs that touch core and may need additional validation. labels Jan 29, 2024
test/benchmark/__init__.py Outdated Show resolved Hide resolved
test/benchmark/load_worlds.py Show resolved Hide resolved
test/benchmark/locations.py Show resolved Hide resolved
test/benchmark/load_worlds.py Show resolved Hide resolved
Copy link
Member

@black-sliver black-sliver left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Things to note:

  • To get proper numbers, you definitely have to run it twice, so the pycache is hot.
  • I'm pretty sure we still do have partial recursive imports in core, so some numbers may not be accurate.
  • The first world to load worlds._bizhawk may have a wrong time, but I don't think we can preload that.

@Berserker66 Berserker66 merged commit 6c19bc4 into main Feb 4, 2024
21 checks passed
@Berserker66 Berserker66 deleted the test_loadtime_benchmark branch February 4, 2024 08:09
Jouramie pushed a commit to Jouramie/Archipelago that referenced this pull request Feb 28, 2024
TheLX5 pushed a commit to TheLX5/Archipelago that referenced this pull request Mar 2, 2024
TheLX5 pushed a commit to TheLX5/Archipelago that referenced this pull request Mar 2, 2024
EmilyV99 pushed a commit to EmilyV99/Archipelago that referenced this pull request Apr 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects: core Issues/PRs that touch core and may need additional validation. is: enhancement Issues requesting new features or pull requests implementing new features.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants