Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[develop] Share the munge key from the Parallel Cluster shared folder #2467

Merged
merged 9 commits into from
Sep 26, 2023
Merged

[develop] Share the munge key from the Parallel Cluster shared folder #2467

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
6b97f55
Change the shared munge key to the shared directory
hehe7318 Sep 21, 2023
5277e96
Share munge key also to LoginNodes
hehe7318 Sep 22, 2023
c4f04f8
Merge branch 'develop' into wip/munge-key-shared
hehe7318 Sep 22, 2023
bc3e6f9
Correct config login and remove unused function in rotation script
hehe7318 Sep 22, 2023
5d3515b
Merge branch 'develop' into wip/munge-key-shared
hehe7318 Sep 22, 2023
345f1e7
Merge branch 'develop' into wip/munge-key-shared
hehe7318 Sep 25, 2023
fd317a2
Address comments.
hehe7318 Sep 25, 2023
4ebfe64
Merge branch 'aws:develop' into wip/munge-key-shared
hehe7318 Sep 26, 2023
440d8ad
Rename SHARED_DIRECTORY to SHARED_DIRECTORY_COMPUTE. Change SlurmSett…
hehe7318 Sep 26, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 5 additions & 3 deletions cookbooks/aws-parallelcluster-slurm/libraries/helpers.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -104,9 +104,11 @@ def share_munge_head_node
group 'root'
code <<-HEAD_SHARE_MUNGE_KEY
set -e
mkdir -p /home/#{node['cluster']['cluster_user']}/.munge
mkdir -p #{node['cluster']['shared_dir']}/.munge
jdeamicis marked this conversation as resolved.
Show resolved Hide resolved
# Copy key to shared dir
cp /etc/munge/munge.key /home/#{node['cluster']['cluster_user']}/.munge/.munge.key
cp /etc/munge/munge.key #{node['cluster']['shared_dir']}/.munge/.munge.key
chmod 0600 #{node['cluster']['shared_dir']}/.munge
chmod 0600 #{node['cluster']['shared_dir']}/.munge/.munge.key
HEAD_SHARE_MUNGE_KEY
end
end
Expand All @@ -119,7 +121,7 @@ def setup_munge_compute_node
code <<-COMPUTE_MUNGE_KEY
set -e
# Copy munge key from shared dir
cp /home/#{node['cluster']['cluster_user']}/.munge/.munge.key /etc/munge/munge.key
cp #{node['cluster']['shared_dir']}/.munge/.munge.key /etc/munge/munge.key
# Set ownership on the key
chown #{node['cluster']['munge']['user']}:#{node['cluster']['munge']['group']} /etc/munge/munge.key
# Enforce correct permission on the key
Expand Down
2 changes: 1 addition & 1 deletion cookbooks/aws-parallelcluster-slurm/recipes/config/config_head_node.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -292,6 +292,6 @@
region: node['cluster']['region'],
munge_user: node['cluster']['munge']['user'],
munge_group: node['cluster']['munge']['group'],
cluster_user: node['cluster']['cluster_user']
shared_directory: node['cluster']['shared_dir']
)
end
2 changes: 1 addition & 1 deletion cookbooks/aws-parallelcluster-slurm/recipes/test/mock_munge_key.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
munge_user_dir = "/home/#{node['cluster']['cluster_user']}/.munge"
munge_user_dir = "#{node['cluster']['shared_dir']}/.munge"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not too sure what this file is for (I guess for some kitchen tests that still need to be developed), but is it correct that this uses the compute node shared folder?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not sure too. Previously, both Login Nodes and Compute Nodes fetch munge key from "/home/#{node['cluster']['cluster_user']}/.munge".
But maybe now we should also mock another
munge_user_dir_login = "#{node['cluster']['shared_dir_login']}/.munge"
and

file "#{munge_user_dir_login}/.munge.key" do
  content 'munge-key'
  owner node['cluster']['munge']['user']
  group node['cluster']['munge']['group']
end

directory munge_user_dir do
mode '1777'
jdeamicis marked this conversation as resolved.
Show resolved Hide resolved
end
Expand Down
2 changes: 1 addition & 1 deletion cookbooks/aws-parallelcluster-slurm/recipes/update/update_head_node.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -212,7 +212,7 @@ def update_nodes_in_queue(strategy, queues)
region: node['cluster']['region'],
munge_user: node['cluster']['munge']['user'],
munge_group: node['cluster']['munge']['group'],
cluster_user: node['cluster']['cluster_user']
shared_directory: node['cluster']['shared_dir']
)
only_if { ::File.exist?(node['cluster']['previous_cluster_config_path']) && is_custom_munge_key_updated? }
end
Expand Down
8 changes: 5 additions & 3 deletions ...books/aws-parallelcluster-slurm/templates/default/slurm/head_node/update_munge_key.sh.erb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ SECRET_ARN="<%= @munge_key_secret_arn %>"
REGION="<%= @region %>"
MUNGE_USER="<%= @munge_user %>"
MUNGE_GROUP="<%= @munge_group %>"
CLUSTER_USER="<%= @cluster_user %>"
SHARED_DIRECTORY="<%= @shared_directory %>"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here again, we must share it also with the login nodes, which use a different shared folder.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you have 5 minutes, please rename SHARED_DIRECTORY to SHARED_DIRECTORY_COMPUTE so that it's immediately distinguishable from SHARED_DIRECTORY_LOGIN.


# If SECRET_ARN is provided, fetch the munge key from Secrets Manager
if [ -n "${SECRET_ARN}" ]; then
Expand Down Expand Up @@ -62,8 +62,10 @@ fi

# Share munge key
echo "Sharing munge key"
mkdir -p /home/${CLUSTER_USER}/.munge
cp /etc/munge/munge.key /home/${CLUSTER_USER}/.munge/.munge.key
mkdir -p ${SHARED_DIRECTORY}/.munge
cp /etc/munge/munge.key ${SHARED_DIRECTORY}/.munge/.munge.key
chmod 0600 ${SHARED_DIRECTORY}/.munge
chmod 0600 ${SHARED_DIRECTORY}/.munge/.munge.key
echo "Shared munge key"

exit 0