Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate Fluxion match performance with different policies, graphs, subsystems #1016

Open
milroy opened this issue Mar 22, 2023 · 1 comment
Labels
performance Fluxion performance and scalability

Comments

@milroy
Copy link
Member

milroy commented Mar 22, 2023

Issue #1001 identified helped identify performance problems with Fluxion matching and scoring on Hetchy. We need to perform a comprehensive study of Fluxion performance under different:

  • simulated current (O(1000) nodes) and next-generation (>O(10,000) nodes) clusters with representative heterogeneity
  • subsystems
  • realistic jobspecs/workloads
  • queue policies
  • match policies
  • scoring

The study will help us understand and prioritize implementing performance improvements.

@milroy milroy added the performance Fluxion performance and scalability label Mar 22, 2023
@tpatki
Copy link
Member

tpatki commented Mar 23, 2023

Maybe we can use PerfFlowAspect for this. Adding @slabasan as well, we had an initial integration of fluxion and PFA that maybe we can start with

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
performance Fluxion performance and scalability
Projects
None yet
Development

No branches or pull requests

2 participants