Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for singularity/apptainer containers #35

Open
dfornika opened this issue Jul 16, 2024 · 1 comment · May be fixed by #39
Open

Add support for singularity/apptainer containers #35

dfornika opened this issue Jul 16, 2024 · 1 comment · May be fixed by #39
Assignees

Comments

@dfornika
Copy link
Member

Build singularity/apptainer images for this pipeline.

See our BCCDC-PHL/routine-assembly pipeline for an example of how to build apptainer containers and publish to the GitHub container registry.

Also investigate using the Sequera Wave system for building containers, if it can be easily integrated.

@dfornika dfornika self-assigned this Jul 16, 2024
@jpalmer37 jpalmer37 linked a pull request Aug 23, 2024 that will close this issue
@jpalmer37
Copy link
Collaborator

I created a draft branch to explore the use of Apptainer for managing pipeline dependencies / execution environments.

Summary of Changes

Created three .def files that define Apptainer images for our three pipeline environments. Right now, this setup builds, stores, and runs images locally, not yet on a cloud repository. All testing was performed on Nextflow version 24.04, which supports apptainer containerization.

Problem

While the initial trimming and filtering steps worked smoothly, the depth_normalization step of the pipeline is extremely slow (might even be broken) when using apptainer. Process was hanging for multiple hours. Might need to investigate tuning the process or apptainer images to get this step working.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants