Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update hpc-slurm-legacy-sharedvpc example and references to use Slurm V6 #2143

Conversation

harshthakkar01
Copy link
Contributor

@harshthakkar01 harshthakkar01 commented Jan 17, 2024

In this PR, I used 1 host project 1 service project and then set up shared VPC in host project. Also, set up firewall rule to allow access (ssh) to this shared VPC network. Below are the result on the login, controller, compute node.

Last login: Wed Jan 24 18:58:43 2024 from 35.235.240.0
[ext_harshthakkar_google_com@hpcsmallsh-login-login-001 ~]$ df -h
Filesystem                       Size  Used Avail Use% Mounted on
devtmpfs                         7.9G     0  7.9G   0% /dev
tmpfs                            7.9G     0  7.9G   0% /dev/shm
tmpfs                            7.9G  8.6M  7.9G   1% /run
tmpfs                            7.9G     0  7.9G   0% /sys/fs/cgroup
/dev/sda2                         50G   16G   35G  32% /
/dev/sda1                        200M  5.8M  195M   3% /boot/efi
tmpfs                            1.6G     0  1.6G   0% /run/user/0
10.43.128.2:/nfsshare           1007G     0  956G   0% /home
hpcsmallsh-controller:/opt/apps   50G   16G   35G  32% /opt/apps
tmpfs                            1.6G     0  1.6G   0% /run/user/3672659445
[ext_harshthakkar_google_com@hpcsmallsh-login-login-001 ~]$ 
  • Controller Node
Last login: Wed Jan 24 18:58:06 2024 from 35.235.240.3
[ext_harshthakkar_google_com@hpcsmallsh-controller ~]$ df -h
Filesystem             Size  Used Avail Use% Mounted on
devtmpfs               7.9G     0  7.9G   0% /dev
tmpfs                  7.9G     0  7.9G   0% /dev/shm
tmpfs                  7.9G  8.6M  7.9G   1% /run
tmpfs                  7.9G     0  7.9G   0% /sys/fs/cgroup
/dev/sda2               50G   16G   35G  32% /
/dev/sda1              200M  5.8M  195M   3% /boot/efi
tmpfs                  1.6G     0  1.6G   0% /run/user/0
10.43.128.2:/nfsshare 1007G     0  956G   0% /home
tmpfs                  1.6G     0  1.6G   0% /run/user/3672659445
[ext_harshthakkar_google_com@hpcsmallsh-controller ~]$
  • Compute node after running slurm job.
ext_harshthakkar_google_com@hpcsmallsh-comput-0 ~]$ 
[ext_harshthakkar_google_com@hpcsmallsh-comput-0 ~]$ df -h
Filesystem                       Size  Used Avail Use% Mounted on
devtmpfs                         119G     0  119G   0% /dev
tmpfs                            119G     0  119G   0% /dev/shm
tmpfs                            119G  8.7M  119G   1% /run
tmpfs                            119G     0  119G   0% /sys/fs/cgroup
/dev/sda2                         50G   17G   34G  34% /
/dev/sda1                        200M  5.8M  195M   3% /boot/efi
tmpfs                             24G     0   24G   0% /run/user/0
tmpfs                             24G     0   24G   0% /run/user/3672659445
hpcsmallsh-controller:/opt/apps   50G   16G   35G  32% /opt/apps
10.43.128.2:/nfsshare           1007G     0  956G   0% /home
[ext_harshthakkar_google_com@hpcsmallsh-comput-0 ~]$ 

Submission Checklist

Please take the following actions before submitting this pull request.

  • Fork your PR branch from the Toolkit "develop" branch (not main)
  • Test all changes with pre-commit in a local branch #
  • Confirm that "make tests" passes all tests
  • Add or modify unit tests to cover code changes
  • Ensure that unit test coverage remains above 80%
  • Update all applicable documentation
  • Follow Cloud HPC Toolkit Contribution guidelines #

@harshthakkar01 harshthakkar01 added the release-improvements Added to release notes under the "Improvements" heading. label Jan 17, 2024
@harshthakkar01 harshthakkar01 force-pushed the update-hpc-slurm-legacy-sharedvpc branch 2 times, most recently from eb25bcd to 083ec46 Compare January 18, 2024 05:10
@mr0re1 mr0re1 assigned harshthakkar01 and unassigned mr0re1 Jan 19, 2024
@harshthakkar01 harshthakkar01 force-pushed the update-hpc-slurm-legacy-sharedvpc branch from 083ec46 to 713217c Compare January 23, 2024 00:50
examples/README.md Outdated Show resolved Hide resolved
community/examples/hpc-slurm-legacy-sharedvpc.yaml Outdated Show resolved Hide resolved
@harshthakkar01 harshthakkar01 force-pushed the update-hpc-slurm-legacy-sharedvpc branch from 0e518b0 to 3c65cfa Compare January 25, 2024 17:50
examples/README.md Outdated Show resolved Hide resolved
examples/README.md Outdated Show resolved Hide resolved
examples/README.md Outdated Show resolved Hide resolved
@harshthakkar01 harshthakkar01 force-pushed the update-hpc-slurm-legacy-sharedvpc branch from 3c65cfa to 1d1f4ef Compare January 25, 2024 19:08
@harshthakkar01 harshthakkar01 force-pushed the update-hpc-slurm-legacy-sharedvpc branch from 1d1f4ef to 615ac7a Compare January 25, 2024 19:12
@harshthakkar01 harshthakkar01 merged commit a64b16c into GoogleCloudPlatform:develop Jan 25, 2024
7 of 33 checks passed
@mr0re1 mr0re1 mentioned this pull request Feb 12, 2024
@nick-stroud nick-stroud mentioned this pull request Feb 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release-improvements Added to release notes under the "Improvements" heading.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants