-
Notifications
You must be signed in to change notification settings - Fork 96
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
WIP: Add maintenance node playbook and vars file #614
Draft
sanjaysrikakulam
wants to merge
14
commits into
usegalaxy-eu:master
Choose a base branch
from
sanjaysrikakulam:maintenance_node
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
WIP: Add maintenance node playbook and vars file #614
sanjaysrikakulam
wants to merge
14
commits into
usegalaxy-eu:master
from
sanjaysrikakulam:maintenance_node
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Additionally fix telegraf's repo key, and update versions of a couple of roles in the requirements file
Look at this PR for changes: usegalaxy-eu#610
Add role to the playbook Add role's pip dependencies to the group_vars file Pin TPV version (refer commiti: 25fd0d5)
Refer commit: 8858ac2
1. Updates maintenance node playbook to new galaxy release 2. Adds new rsync role that would perform rsync to the NFS share and to the headnodes
Updates the galaxy-rsync script Includes vault file to the playbook Uncomment telegraf role so VGCN-monitoring role can be installed and comment the telegraf_plugins_extra dict in group_vars as these plugins are currently active in the headnodes playbook. When its disabled/removed there we can enable them here
mira-miracoli
approved these changes
Apr 4, 2023
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me, let's try it!
mira-miracoli
approved these changes
May 8, 2023
... requirements.yaml file
mira-miracoli
approved these changes
May 8, 2023
mira-miracoli
approved these changes
May 9, 2023
Co-authored-by: Mira <[email protected]>
Co-authored-by: Mira <[email protected]>
sanjaysrikakulam
changed the title
Add maintenance node playbook and vars file
WIP: Add maintenance node playbook and vars file
May 25, 2023
Converting this PR to |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose:
maintenance.galaxyproject.eu
. This new node will host all galaxy configs, codebase, etc. Once in production, the codebase will be synced to NFS and then both head nodes can sync from NFS to serve.Maintenance VM details:
See here and here
NOTES:
/opt/galaxy
has been moved to run only on the maintenance node. Documentation on which role should run where is available in our operations repo (PR: Add head and maintenance node ansible roles doc operations#21)/opt/galaxy
to NFS and then the head nodes should do a sync from NFS to its/opt/galaxy
. Therefore, we would need a new rsync from NFS task on the head nodes such that they can fetch and keep/opt/galaxy
in sync. Also, we should add a cron job of the same (just like the one we have that syncs to NFS).Changes compared to the head nodes playbooks:
usegalaxy_eu.handy
collection, andusegalaxy_eu.gie_proxy
role inrequirements.yaml
.group_vars
folder.usegalaxy_eu.htcondor
. Also update therequirements.yaml
file with the latest version of that role._galaxy_
conda env with Python 3.8.8 (this is the version that's currently installed onsn06
galaxy's venv) and then use thevirtualenv
and thepython
command to create galaxy's venv in/opt/galaxy/venv
. Also, we use the same for other Ansible roles (for example:usegalaxy_eu.gie_proxy
).usegalaxy_eu.gie_proxy
. Also introduced a variable that would enable us to install some parts of it on the maintenance node and some parts of it on the head node (for example, the systemd service unit file. This should be available and enabled only on the head nodes). So, on the maintenance node the variablegie_proxy_install
should be set totrue
and thegie_proxy_setup_service
variable tonone
. On our head nodes playbook we should set the followinggie_proxy_install: false
,gie_proxy_setup_service: systemd
,gie_proxy_setup_nodejs: none
."{{ galaxy_server_dir }}/lib/galaxy/tools/toolbox"
to here"{{ galaxy_server_dir }}/lib/galaxy/tool_util/toolbox"
.bashrc
. PR: Update bashrc and postgres-connection roles #610Merge this PR only after these: