Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DRAFT] Configure Enroot and Pyxis only on HeadNode #2816

Closed
wants to merge 1 commit into from

Conversation

himani2411
Copy link
Contributor

@himani2411 himani2411 commented Oct 10, 2024

Description of changes

  • Running Config Phase of Enroot and Pyxis only on HeadNode
  • Replacing sed commands with templates

Tests

  • Create ParallelCluster AMI
  • Test scaling of 200 nodes
    • [ONGOIN}Created a cluster with SharedStorageType: Efs
      • Tested with ExtarChefAttributes {"cluster":{"pyxis":{"enabled":true},"enroot":{"enabled":true}}}
    • [SUCCESS]Created a cluster with SharedStorageType: Efs
      • Without Configuring pyxis and enroot

References

  • Link to impacted open issues.
  • Link to related PRs in other packages (i.e. cookbook, node).
  • Link to documentation useful to understand the changes.

Checklist

  • Make sure you are pointing to the right branch.
  • If you're creating a patch for a branch other than develop add the branch name as prefix in the PR title (e.g. [release-3.6]).
  • Check all commits' messages are clear, describing what and why vs how.
  • Make sure to have added unit tests or integration tests to cover the new/modified code.
  • Check if documentation is impacted by this change.

Please review the guidelines for contributing and Pull Request Instructions.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@himani2411 himani2411 requested review from a team as code owners October 10, 2024 18:58
@himani2411 himani2411 changed the base branch from develop to release-3.11 October 10, 2024 18:59
@himani2411 himani2411 changed the title Running Config Phase of Enroot and Pyxis only on HeadNode [DRAFT] Configure Enroot and Pyxis only on HeadNode Oct 10, 2024
Copy link

codecov bot commented Oct 10, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Please upload report for BASE (release-3.11@b00a0c6). Learn more about missing BASE report.

Additional details and impacted files
@@               Coverage Diff               @@
##             release-3.11    #2816   +/-   ##
===============================================
  Coverage                ?   76.67%           
===============================================
  Files                   ?       22           
  Lines                   ?     2242           
  Branches                ?        0           
===============================================
  Hits                    ?     1719           
  Misses                  ?      523           
  Partials                ?        0           
Flag Coverage Δ
unittests 76.67% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@himani2411 himani2411 force-pushed the release-3.11.1 branch 4 times, most recently from 9a091ef to e77e02b Compare October 10, 2024 23:34
@himani2411 himani2411 marked this pull request as draft October 10, 2024 23:36
@himani2411 himani2411 force-pushed the release-3.11.1 branch 5 times, most recently from 9321be0 to 6d017a9 Compare October 11, 2024 13:24
directory "#{node['cluster']['shared_dir']}/enroot" do
owner node['cluster']['cluster_user']
# group node['cluster']['cluster_user']
mode '1777'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shouldn't this be 0755?

@himani2411 himani2411 force-pushed the release-3.11.1 branch 10 times, most recently from 4f2fc28 to bbabdf0 Compare October 11, 2024 19:16
@himani2411 himani2411 force-pushed the release-3.11.1 branch 4 times, most recently from 57e5199 to 2efe619 Compare October 12, 2024 04:10
* Replacing sed commands with templates

* Replacing creation of directories with chef resource

* Adding Chef Attributes for enabling Pyxis

* Changing Kitchen test for Enroot and Pyxis
ENROOT_CACHE_PATH ${ENROOT_CACHE_PATH}
ENROOT_DATA_PATH /tmp/enroot/data/user-$(id -u)
ENROOT_RUNTIME_PATH /run/enroot/user-$(id -u)
ENROOT_CONFIG_PATH
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should create an enroot config path. Like /home/user-$(id -u)/.config/enroot

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Our users could share the /home folder and we would end up in the original situation where these paths expected to be local became shared. I suggest to avoid the use of /home for these paths. In Pyxis/Enroot docs/Example sometimes they mention /home because they assume it's a local folder.

@gmarciani
Copy link
Contributor

Closed in favour of #2820

@gmarciani gmarciani closed this Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants