Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enrich synthetic data set with shared blocks #521

Closed
ppebay opened this issue Jul 14, 2024 · 1 comment · Fixed by #522
Closed

Enrich synthetic data set with shared blocks #521

ppebay opened this issue Jul 14, 2024 · 1 comment · Fixed by #522
Assignees
Labels
enhancement New feature or request

Comments

@ppebay
Copy link
Contributor

ppebay commented Jul 14, 2024

The goal of this issue two-fold:

This is an enrichment as follows: 3 equally-sized shared memory blocks, each homed to the rank with the same index, with all objects of said ranks partaking into their homed block, as follows:

conf-blocks

The salient points of this configuration as are as follows:

  1. the homed blocks will increasingly anchor the objects to their initial rank assignments, as $\delta$ will increase, hence counteracting the load-balancing pull;
  2. the shared block relationships form 3 distinct object connected components: (0,1,2,3), (4,5,6,7), and (8), thus counteracting the 2 distinct object communication connected components: (0,2,3,5,6,7,8), and (1,4), depending on the relative values of $\beta$, $\gamma$ , and of the upper bound on rank memory.
@ppebay
Copy link
Contributor Author

ppebay commented Jul 18, 2024

As per discussion with @lifflander and @nlslatt, test case is modified as follows:

348563897-a179fb82-608b-4946-8f58-67b46b8d3dc8

in order to allow for full-cluster swaps to take place (as opposed to requiring sub-clustering when memory limit is tight).

ppebay added a commit that referenced this issue Jul 18, 2024
cwschilly added a commit that referenced this issue Jul 25, 2024
cwschilly pushed a commit that referenced this issue Jul 25, 2024
cwschilly pushed a commit that referenced this issue Jul 25, 2024
cwschilly added a commit that referenced this issue Jul 25, 2024
ppebay added a commit that referenced this issue Jul 26, 2024
cwschilly added a commit that referenced this issue Jul 26, 2024
ppebay added a commit that referenced this issue Jul 26, 2024
* #521: description, constructing script, and dataset files

* #521: Configuration file to run the synthetic+blocks case through PhaseStepper and render it

* #521: modified example and specification

* #521: new test case

* #521: excluse pngs from trailing whitespace check

* #521: fix png whitespace error

* #521: pull in LBDatafile_schema.py with JSON_data_files_validator.py

* #521: finalized example and configuration with baseline load-only setting that must reach 0 imbalance

* #521: generalize whitespace check to ignore all pngs

* #521: remove unused imports

---------

Co-authored-by: Caleb Schilly <[email protected]>
github-actions bot pushed a commit that referenced this issue Jul 26, 2024
* #521: description, constructing script, and dataset files

* #521: Configuration file to run the synthetic+blocks case through PhaseStepper and render it

* #521: modified example and specification

* #521: new test case

* #521: excluse pngs from trailing whitespace check

* #521: fix png whitespace error

* #521: pull in LBDatafile_schema.py with JSON_data_files_validator.py

* #521: finalized example and configuration with baseline load-only setting that must reach 0 imbalance

* #521: generalize whitespace check to ignore all pngs

* #521: remove unused imports

---------

Co-authored-by: Caleb Schilly <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant